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Abatract 

A  functional  repreaentatlon,  which  ia  a  genort.lisation  of  the  linear  convolution  Inte¬ 
gral,  la  uecd  to  deacribe  contlnuoua  nonlinear  ayatema,  Emphaaia  ia  placed  on  nonllneur 
ayatema  compoaed  of  linear  aubayateina  with  memory,  and  tionlinear  no-memory 
aubayatema.  An  "Algebra  of  Syatema"  ia  developed  to  facilitate  the  deucriptlon  of  anch 
combined  ayatema.  From  thla  algebraic  deacription,  multldimeiiBlonal  ayatom  trnnn- 
forma  are  obtained.  Theae  traraforma  apeclfy  the  ayatem  in  much  the  same  manner  aa 
one -dimenalonal  transforms  specify  linear  ayateme.  The  syatem  transforms  and  the 
transform  of  the  system's  input  signal  are  then  used  to  determini,  the  transform  the 
output  signal.  Transform  theory  la  also  uaed  for  determining  averages  and  apectra  of 
the  system  output  vhen  the  input  ia  a  random  signal  Oauar  ^nlv  distributed.  Certain 
theoretical  aspt  i.-i  of  the  fan''tional  representation  arc  diet,  uaeed. 
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>.  IN  THOU  UCT  ION 


1.1  SYSTEM  ANALYSIS 

In  physical  analysis,  a  "system"  is  often  used  to  specify  the  relation  between  a  cause 
and  an  effec*  In  system  tcirminology,  the  cause  is  the  system  input  and  the  effect  is  the 
output.  This  is  represented  in  Kig.  1,  where  x  is  the  input  signal  and  f  is  the  output 

signal.  Uaually  these  signals  are  functinita  of  time.  Of 
the  several  general  classifications  of  systems,  the  class 
that  has  been  most  successfully  studied  is  the  linear, 
time  •stationary  My'rr.',,  This  report  is  concerned  with 
the  nonlinear,  stationary  system  -  particularly  the  con¬ 
tinuous  nonlinear  stationary  system.  The  continuous  ncn- 
llnear  system  will  be  described  in  detail  in  section  6,8, 
The  continuous  concept  .'•nplies  a  certain  degree  of  smoothness  in  the  system's  input- 
output  relation,  The  linear  system  can  be  regarded  as  a  special  case  of  the  continuous 
nonlinear  system. 

The  anslysis  of  a  system  is  dependent  upon  finding  a  mathematic  .il  description  of  the 
relation  between  the  system  input  and  the  system  output.  Classically,  the  relation  is 
obtalnsd  by  means  of  a  differential  equation.  However,  the  present  means  of  repre¬ 
senting  a  linear  system  is  by  the  convolution  integral  and  its  associated  transforms. 

The  mathematiosl  representation  for  nonlinear  systems  which  forms  the  basis  of  this 
report  1«  tlcvely  related  to  these  modern  methods  for  linear  system  analysis. 

l.a  rUNCTIONAL  REPRESENTATION 

A  function  f  operates  on  a  set  of  variables  x  to  produce  a  new  set  of  variables  f(x), 

A  functional,  however,  operates  on  a  set  of  functions  u  ’d  produces  a  new  set  of  functions 
In  other  words,  a  functional  U  a  .unction  of  a  function, 

The  mathematical  description  used  in  this  report  to  represent  a  nonlinear  system  Is 
the  functional  series: 

f»«e  <ue  j$» 

f(t)  •  /  hj(T)  x(t-T)  dr  +  I  /  hj(Tj,  Tg)  x(t-Tj)  xlt'T^)  dTjdTj 

n  . +  . . .  (1) 

where  f(t)  is  the  system  output,  and  x(t)  Is  the  cystem  Input.  The  firet  '  n  in  this 
series  is  the  ordinary  convolution  integral  that  i*  used  for  linear  syutem  unalyslF  The 
other  terms  are  generalizations  of  this  iinear  convolution  term.  In  linesr  system  theory, 
the  function  h|(t)  is  known  as  the  "impulse  response."  sectior  1,5,  the  function 
h^(t t^)  will  Lii  shown  to  be  a  generalized  impulse  rec,  In  this  r  port,  *he 
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Fig.  I.  Nonlinear  system. 
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limita  of  integration,  unlesn  otherwise  indicaicii,  will  be  from  to  *, 

1.3  HISTORICAL  NOTE 

These  functionals  were  studied  by  Volterra  (1)  early  in  the  t-viMitleth  liertiiry.  In 
1942,  Wiener  (2)  first  applied  the  functional  series  to  the  study  of  «  nonlinear  electrical 
circuit  problem.  He  was  concerned  with  computing  tne  output  moments  of  a  detector 
circuit  w^th  a  random  input.  Later,  he  used  this  representation  as  the  basin  for  a 
canonical  form  for  nonlinear  systems  ()}, 

More  recently,  the  functional  representation  has  been  investigated  by  a  number  of 
workers.  Bose  (3)  investigated  the  canonical  form  problem  and  developed  a  syutem 
that  overcame  many  of  the  difficulties  associated  with  Wiener's  system.  Brilliant  (4) 
was  concerned  with  the  validity  of  the  functional  representation,  and  found  that  systems 
satisfying  a  certain  continuity  condition  could  be  represented.  He  also  showed  that  the 
representation  was  well  suited  to  the  combining  of  nonlinear  systems . 

Wiener  and  other.4  have  extended  the  application  of  this  functional  representation, 
in  the  random  input  case,  beyond  the  results  of  Wiener's  paper  of  1942,  Wiener  (S) 
developed  the  rigorous  theory  for  random  (white  Oattssinn)  inp'its  and  applied  the  theory 
to  such  situations  as  are  found  in  PM  spectra.  Barrett's  (6)  paper  is  an  excellent  expo¬ 
sition  of  the  state  of  this  theory  at  the  time  the  present  work  was  undertaken. 

1.4  COMPARISON  OF  THE  FUNCTIONAL  APPROACH  WITH  OTHER  NONLINEAR 
METHODS 

The  analysis  of  nokilinear  systems  has  been  an  interesting  problem  for  many  years, 
it  la  therefore  of  b  '  :  it  to  compare  the  preaeat  state  of  the  functional  approach  with  the 
pt'lncipai  classical  methods.  There  are  two  u.uin  classes  of  solutions  to  nonlinear  prob¬ 
lems!  trunsient  solutions,  and  fteady«state  solutions. 

Transient  solutions  are  obtained  classically  by  the  solution  of  nonlinear  differential 
equations  (7).  For  first-order  equations,  solutioiw  can  usually  be  obtained  formally, 
although  numerical  integration  procedures  may  be  required.  However,  biily  apeoial 
forma  of  second -order  equations  can  be  sv<v)d.  Force -free  solutions  for  second -order 
equations  oan  be  found  with  the  phase-plane  method  -  even  for  extremely  violent  nonltn- 
caritles.  Examples  of  violent  and  noiiviolei't  nonllnearltes  ere  shown  in  Fig.  2.  Oen- 
erally,  numerical  techniques  must  be  ueed  to  sulve  higher -order  equations. 

Sinusoidal  steady -state  aolutlons  oan  be  obtained  for  eyetems  in  which  the  first 
harmonic  is  the  only  algnifloant  term.  This  is  the  basle  for  the  "d.  Bcribing  function 
method"  (8),  and  for  some  others.  System  order  i.i  not  a  limiting  factor,  nor,  generally, 
la  the  violence  of  the  nonlinearity. 

The  functional  aeries  (Eq.  1)  is  every  general  method  for  repr«>.  *  ntlng  nonlinear 
systema  (see  seoa.  2.1  and  6.8).  However,  at  least  in  the  present  state  of  these  methods, 
it  does  have  a  definite  practical  limitation.  If  the  nonlinnarlties  In  a  ayatem  are  too 
vloleiit,  the  number  of  terms  required  for  a  close  approvimation  becomes  very  large. 
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Fig.  2.  yjolenat  of  nonllnearltl;*!  (»)  nonviolent  nonlinearity 
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It  would  then  be  necessary  to  resoit  o;  a  computer,  and  a  great  deal  c  the  value  r-.;  the 
method  would  be  lost,  tiowever,  if  the  nonJinearities;  are  sufficiently  smooth,  the  trans¬ 
ient  response  of  a  system  is  determined  by  the  first  few  terms  of  the  series,  and  there 
is  little  limitation  from  system  order.  Also,  steady -state  solutions  do  not  require  that 
the  first  harmonic  be  the  only  significant  term 

Thi  comparisons  that  have  just  been  made  are  illustrated  graphically  in  Fig.  3,  The 
shaded  areas  show  the  regions  of  effectiveness  of  various  methods  of  anai,vslj.  However, 
the  graphs  shculd  not  be  taken  to  mean  that  these  methods  can  cover  all  uystems  in  the 
shaded  regions,  but  only  a  significantly  large  number. 

The  first  problem  In  system  analysis  is  to  find  a  suitable  mathematical  description. 
This  description  is  called  the  "system  representation."  The  functional  representation 
studied  in  this  report  has  three  important  properties: 

(a)  It  has  an  explicit  input -output  relation. 

(b)  It  facilitates  the  combination  of  systems. 

(o)  It  allows  the  consideration  of  random  inputs. 

If  a  representation  has  an  Implicit  -  rather  than  explicit  -  input -output  relation.  It  means 
that  the  whole  problem  must  be  re -solved  for  each  different  input.  (The  differential 
equation  representation  Is  ImpUoit.)  Property  (b)  is  important  because  the  electrical 
engineer  spends  a  great  deal  of  time  "putting  things  together,"  The  effect  of  random 
Inputs  is  a  problem  of  grent  interest  to  the  engineer. 

The  classical  methods  based  on  the  differential  equation  have  none  of  these  proper¬ 
ties.  On  the  other  hand,  the  significance  of  transform  and  convolution  methods  in  linear 
system  snsiysi'  '  ..Is  heavily  on  these  properHes,  Therefore,  these  three  properties 
give  three  distinot  advantages  to  the  functi  uml  representation  as  compared  with  the 
olaseical  nonlinear  method*. 

1.5  INTERPRETATION  OF  THE  FUNCTIONAL  SERIES 

Having  Indicated  the  position  of  the  functional  representation  in  the  general  field  of 
nonlinear  system  analysis,  the  writer  would  like  to  present  an  interpretation  of  the 
functional  series,  First  of  all,  the  series  (Eq.  1)  can  be  viewed  a'^  n  earies  of  time 
funationei 

f(t)  ■>  f,{t)  t  fjd)  +  ...  +f„(t)  +  ...  (2) 

where 

fn(t)  ■=/•../  . V  )  . . .  x(t-T^,)  dT,  . . .  dT^  (3) 

That  is,  at  some  time  t  j  we  have  a  series  of  numbers  that  add  up  to  give  the 

actual  value  of  the  system  output  f(t|}.  Also,  each  of  the  fuuctlono  (^(t)  is  s'vjn  from 
Eq.  3  to  be  the  result  of  a  convolution  operation  on  the  input  time  function  x(t).  The 
first  term.  t.  (t),  in  particular,  is  recognised  as  bei  '  the  result  of  pi'.ttlng  x(t)  into  a 
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linear  system  with  an  Impulse  response,  Indeed,  each  term  f^(t)  can  be  viewed 

as  the  output  of  a  system  wit;  input  x<t). 

To  tail ,  advantage  of  this  idea,  we  introduce  an 
operator  notation.  In  this  notation,  if  v'e  have  a  gen> 
f  rral  nonlinear  system  with  output  :(t)  and  input  x(t),  as 

*  illustrated  in  Fig,  1,  then  we  can  write  f(t)  = 

or  if  we  make  the  time  dependence  implicit,  f  ^  H[x]. 
Fig.  4.  Nonlinear  eystem.  Then ‘he  symbol  H  represents  the  operation  that  the 

systert  makes  on  input  x  to  produce  output  f.  In  dia¬ 
gram  form,  a  nonlinear  systeiu  is  then  represented  as  shown  in  Fig.  4.  (The  usual 
operator  notation  la  replaced  by  H  in  this  rop':,''.) 

The  first  term  can  be  viewed  as  a  linear  system  operation,  and  therefore 

fl(t) 

or 

where  the  subsoript  "1"  is  added  to  the  g  notation  to  denote  that  the  operation  is  linear. 
Now,  a  linear  system  is  apsolfied  by  means  of  its  impulse  responaej  and  thus,  associated 
with  the  linear  system  Hj^,  there  is  an  impulse  response  h|^(t),  and 

fj(t)  «  J"  hj(T)  x(t-T)  dr 

Now,  liie  ‘rriTi  in  the  Berles  (Eq.  2)  is 

f2(t)  *J‘J*  T^)  X(t-Tj)  dTjdTg  (4) 

If  the  input  x(t)  is  changed  by  a  <rain  factor  c  to  give  a  new  input  ex(t},  then  the  new 
output,  g2(t).  is 

■  J’ y  *>2(^1,  Tg)  Cx(t-T,)  fxU-Tj)  dTjdTj 

or 

•  t\(t) 

Thus,  the  eecond  term  ie  the  reeuit  of  a  quadratic  (or  squaring)  operntion.  In  the  oper¬ 
ator  notation,  then,  where  the  subscript  "2"  indicates  that  this  is  a  quadratic 

operation,  Similarly,  fj  »  Hj[x]  and,  in  general,  f^  ”  H^[x].  Associated  with  each 

is  the  function  h„(t,, . , .  ,t„),  and 
n  1  n 

f„{t)-y...  f  h  Jr  ^ . r^)x(t-T,)..,  *(t-Tj  dv.dT^ 
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In  the  light  of  these  remarks,  Eq,  I  can  be  rewritten  as 

f  =  Hj[x]  +  Hjx]  +  . . .  +  H^[x)  +  . .  .  ;6) 

That  is,  the  system  H  has  been  broken  into  a  parallel  combination  of  syatems  an 

shown  in  Fig.  5.  This  is  the  desired  inter - 
preiation:  The  functional  reprenentatiun 
represents  a  nonlinear  system  as  a  par¬ 
allel  bank  of  systems  that  are  n*^- 
orrier  nonlinear  systems  and  have  an 
Impulse -response  function  •  •  •  .tj^) 
associated  with  them. 

The  next  task  is  to  show  how  these 
funntionj  interpreted 

as  impulse  responses.  The  linear  case 
is  well  known.  If  f.  «  H,[x],  and  x(t)  a 
*■  rTrw.ntltlo'S.'"''  an  impulse  at  time  -T.  then  f,(0)  = 

hj(T),  where  hjit)  is  the  impulse  response. 
Now  consider  a  generalization  of  the  second  term  of  the  functional  series 

"  Jf  ’'2^  yft-Tg)  dTjdT2  (7) 

and  represent  this  operationally  by 

«i.  » a,(xy)  (8) 

This  operational  form  will  bo  considered  in  treater  detail  in  section  2, 2.  The  difference 
between  fj  •  °  should  be  noted.  The  square  brackets  denote  an  actual 

system  operation,  and  the  parentheses  denote  a  mathematical  operation  on  a  pair  of  func¬ 
tions.  Such  a  form  (Bq.  8)  cannot  occur  by  itself  uecause  only  single-input  syetems  u.v 
being  studied.  However,  it  can  ooour  in  combination  with  other  terms.  Consider  the 
system  operation  fj  ■ 

Using  Eq.  4  (the  actual  functional  relation)  with  Eqs,  7  and  8,  we  obtain 
fj  -  H2(xx)  +  +  »i<yx)  +  Sz(yy) 

but  h2(tj,t2)  is  a  symmetrical  function,  and  so 

f2  =■  +  2iiz(xyi  +  H2(y’‘)  (9) 

where  xx  ■  x  and  yy  °  y  .  In  the  functional  form  for  the  second -order  case  (Eq.  7), 
with  hj(tj,t2)'*  h2(t2,tj),  the  symmetrical  function  [h2(tj,t2)+h2(t2,tj)j/2  can  be  formed 
and  substituted  for  h2(t|,t2)  without  affecting  f2(t).  This  prowedure  (5)  genera,.zeB  to 
h„(tp  . . . ,  t^),  and  so  it  will  generally  be  assumed  in  this  report  that  h^(t  j, ....  t^)  is  a 
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symmetrical  function  in  tj.  t2i  t^< 

In  Rq.  9,  li2(sy)  has  kuen  obtained,  but  it  is  in  combination  with  two  other  terms , 
Figure  6  shows  how  isolated  experimentally.  If  the  mdic>'*cd  operations 

were  performed  sequentially,  only  oca 


*0 — \ 


St 


tID.IIc'tl 


system  ii2  would  be  needed.  In  the  system 
of  Fig.  6,  if  x(t)  «  6(HTj)  and  /(f)  «  6(t+T2). 
then  the  output  p  is  p  -  tl2(xy),  and,  at 
time  0,  p(0)  ■  h2(Tj,  Tj).  This  is  proved 
by  substituting  these  values  of  x(t)  and  y(t) 
in  ciq.  7.  Thus,  h2(tj,t2)  can  be  inter¬ 
preted  as  vn  impulse  response  in  n  m;'nner 


Fig,  6.  Apparatus  for  isolating  H2(tiy)* 

similar  to  the  interpretation  of  the  linear 
response  h|(t).  This  approach  can  be  generalised  to  the  n*** -order  case,  and  all  func¬ 
tions  h^(t|, . . .  .t^)  may  be  called  impulse  respc.'taas.  In  section  4. 8  we  shell  be  con¬ 
cerned  with  measuring  thane  .impulse  responses. 

Tosummsrlsa,  the  functional  ssrlss  mry  be  regardeo  as  representing  s  nonlinear 
system  as  a  parallal  bank  of  nuAllnaar  aubsyateina  (or  operators).  Bach  of  these  sub- 
aysteme  is  specified  by  an  impulse  response,  h^(t|, . .  • 


1.8  SYSTEM  TRANSFORMS 

It  thf;  'mniiife  responses  hjCtj.  •••»t|^)  ore  known  for  s  system,  then  the  output  f(t), 
lor  s  given  fn.  ..1  can  be  obtsiurd  from  Kq.  i.  However,  the  analyeia  of  linear  sys¬ 
tems  has  bean  greatly  aided  by  the  fact  that  ''umtvoiution  in  the  time  domain  is  multiplica¬ 
tion  in  the  frequency  domain."  An  analogous  result  holds  for  nonlintsr  systems  -  except 
that  multiple -order  transformations  must  be  uceH 

These  transforms  are  def  led  by  ti  e  transform  pairs! 


^<•1 . V"/-'- . 

Vsxp(siti*...+s„t„)dt,  ...  dt„ 

(10) 

And 

^<‘1 . 

.a„)exp(-Sjt,-...-s^t„)da,  ...  ds„ 

(11) 

Appropriate  contours  of  Integrafion  and  valuea  of  Sj,  S2.  and  ao  on  can  be  choaen  in  a 
manner  similnr  to  that  in  the  linear  transform  csss  to  give  Fourier  or  Laplace  trane  - 
formations. 

The  value  of  the  higher  -order  traneform  theory  Use  in  the  fact  thu. 

/••• . 

(12) 

>iaa  an  n^^-ord.ir  transform,  •  • 

•  •  •fl)  ^n^*l  ’  ■  ’ '  ''n^‘ 
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Now,  consider 


(13) 


which  is  4  special  case  of  Eq.  12,  and  thus  will  have  a  transform,  * 

^2^*1' ^2^  X(Sj)  X(s2)>  We  are  interested  in  the  special  case  of  Eq  13,  with  tj  °  t2  °  t. 
Then 


=■  x(t-Tj)  x(t- 


r^)  dT,dT2 


(U) 


which  is  the  second  term  in  the  funcilonal  series,  dimllarly,  the  output  ot p  -order 
system  can  be  made  artificially  a  function  of  tj,  . . . ,  t^,  in  order  to  take  advantage  of 
transform  theory.  The  discussion  at  this  point  is  only  Intended  to  define  the  transforms 
and  Indicate  their  possible  application.  In  Section  III  we  shall  show  how  the  transformb 
can  be  used  to  obtain  the  systec.t  output. 


1.7  SUMMARY 

We  have  given  an  introduction  to  the  functional  representation  for  nonlinear  systems. 
This  functional  method  can  be  used  to  solve  a  large  class  of  nonlinear  problems  in  which 
the  classical  methods  fall,  but  it  does  have  certain  limitations,  certainly,  at  the  present 
stage  of  development.  Furthermore,  the  functional  representation  has  three  very  desir¬ 
able  prop.  -'^irr  «het  maVe  it  a  method  of  considerable  strength  and  value, 

We  have  suen  that  the  representaticr.  may  be  viewed  as  a  parallel  bank  of  nonlinear 
operations  or  subsystems.  These  subsystems  are  generalisations  of  the  ordinary  linsar 
convolution  operation,  and  are  specified  by  impulse  responses.  Finally,  the  higher- 
order  transform  has  been  introduced,  and  its  poU"  !lnl  use  indicated. 


n.  AN  ALGEBRA  OF  SYSTEMS 


i,  1  INTRODUCTION 

The  second  property  of  the  functional  representation  is  that  it  facilitates  the  com¬ 
bination  of  systems.  This  property  was  noticed  by  Brilliant  (4),  and  he  obtained  formu¬ 
las  for  findint  the  impulse  responses  l  >d  transforms  of  the  component  subsystems. 
However,  these  formulas  are  difficult  to  use,  and  do  not  indicate  how  the  components  of 
a  system  combine  to  produce  the  over -all  system.  These  difficulties  can  be  overcome 
by  means  of  a  representation  in  which  the  whole  sytic.-m  can  be  expressed  by  a  single 
equation.  This  representation,  which  is  called  the  "Algebra  of  Systems,"  makes  use  of 
the  operator  system  notation  that  was  introduced  in  section  1.  5. 


It) 

Fig,  7,  Examples  of  nonlinear  systema;  (a)  nonlinear  capacitor; 

(b)  do  motor. 

We  are  primarily  concerned  with  a  certain  class  of  physical  systems.  In  this  class, 
the  systems  are  composed  of; 

(a)  nonlinear  subsystems  with  no  memory  (that  Is,  the  outputs  depend  on  Uic  instan¬ 
taneous  value  of  the  input  and  are  Independent  of  the  past  or  future  values  of  the  input); 

(b)  linear  subsystems  that,  in  general,  have  memory. 

This  class  of  systems  is  of  a  very  general  nature.  The  only  cImss  ol  syblem  that  appears 
to  be  definitely  excluded  is  the  hysteretlc  system.  Two  examples  are  shown  in  Fig,  7. 

The  nonlinear  capacitor,  viewed  as  a  system,  is  equivalent  to  an  integrator  followed 
oy  a  nonlinear  no-memory  operation.  We  can  see  this  by  considering  the  capacitor  equa¬ 
tion 

e  *  n(q)  (15) 

where  e  represents  voltage  and  q,  charge,  and  the  functi  ■  r  represents  the  nonlinear 
rel.itlon  betweer  jharge  and  voltage.  Then 
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(16) 


0  t 

q{t)  =  j  i(t)  dt 
J-oo 

where  l(t)  Is  the  current.  Thr  block  of  Fig.  7a  shows  this  rel::;ian  between  cur> 

rent  and  voltage. 

The  relation  between  the  speed  w  and  the  armature  voltage  e  of  the  do  motor  is  given 
by 

e  »  kj  |«+n(<ii)+k2 (17) 

where  k^  and  are  oonatanta,  and  n  la  a  function  representing  the  nonlinear  oharaater- 
istio  of  the  motor.  Thus,  the  motor  is  equivalent  to  the  oirouit  shown  in  Fig.  7,  with 
C  ■  kj  (see  Truxal  (8)). 

We  know  how  to  dssarlba  the  linear  ayatem  and  the  nonlinear  no«memory  syatem. 

The  linear  ayatem  can  be  deaoribed  by  ita  impulao  response  or  transform,  and  the  non- 
linoar  no  •memory  ayatem  can  be  deaoribed  by  a  function  relating  ita  input  and  output. 

The  use  of  the  funotional  representation  depends  on  our  being  able  to  write,  or  approx¬ 
imate,  this  nonlinear  function  by  a  power  aeries  or  a  polynomial.  For  example,  the 
saturating  system  of  Fig.  2a  can  be  approximated  over  a  desired  interval  by 

f-a,x  +  a3X»  +  ...  +a2n+iX*"+‘  (18) 

The  ideal  clipper  of  Fig.  2b,  on  the  other  hand,  would  require  an  extremely  large  n  for 
apprnv^mstton  in  the  form  of  Eq.  17.  This  is  a  praotioal  limitation.  Even  very  violent 
nonlinearltiua,  '".v...  the  ideal  clipper,  non.  theoretloally,  be  vary  closely  approxi¬ 
mated  by  a  polynomial. 

Now  the  situation  is:  Wo  are  given  a  system  (n  which  the  component  aubayatema  are 
linear,  or  nonlinear  no-memory,  and  we  want  to  Uoi'ti’.rtbe  the  over-all  ayatem  by  the 
funotional  repreaentatlon.  To  'o  thla,  Ihe  aubaystema  (which  we  know  how  to  draoribe) 
muat  be  combined.  Therefore,  the  ability  to  conveniently  combine  aystoma  ia  very 
important  in  the  uae  of  the  fUnottoiial  repreaentatlon  for  ayatem  analyaia. 

It  can  be  aaid  that  not  only  is  the  ability  to  combine  nonlinear  systems  an  Important 
engineering  problem  but  also  that  this  ability  is  a  basic  need  in  the  use  of  the  funotional 
representation.  The  algebra  of  systems  will  be  developed  and  the  relation  to  the  syatem 
impulse  responses  and  transforms  shown. 

2.2  FUNCTIONAL  OPERATIONS 

We  introduced  the  operational  notation  in  Section  1.  For  a  general  system  that  oper¬ 
ates  on  an  input  x(t)  to  produce  an  output  f(t)  (see  Fig.  1),  f(t)  ■  tl[x(t)]  or  f  ■  il[x],  where 
t  is  implicit.  The  system  operation  (Eq.  3)  is  denoted  by  f^  ■  if|,[x].  Then,  the  func¬ 
tional  series  (Eq.  1)  becomes  f  ■  ti][xj  *  . . .  +  -t  •  •  ■  •  If  this  form  is 

truncated  at  some  tf^[x],  it  is  then  a  functional  polynomial. 

Now.  if  f^  •  H„[x],  then 
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g„  >  Hjfx]  =  e^l*]  -  09) 

where  c  ie  a  constant.  If  f(t)  Is  the  output  of  system  H  with  input  x(t),  and  f^(t)  is  the 
output  with  <nput  ex(t),  it  follows  that 

f^  -  £Hi[x]  +  c2h2[x]  +  . . .  +  +  . . .  (20) 

The  usual  Taylor,  or  power,  series  la 

aj€4  .2€*+...  +  a„i*'  +  ...  (21) 

and  comparison  of  Eqs.  20  and  21  shows  that  the  functional  series  is  very  similar  to  a 
power  series.  It  will  be  shown  in  section  6,  i  that  there  is  a  strong  mathematical  con¬ 
nection  between  them.  This  relationship  serves  to  relate  the  functional  series  to  ordi¬ 
nary  mathematical  series. 

We  have  represented  the  generalised  second-order  operation 


g2(t)  ■  J* J*  h2(Tj,  Tj)  x(t-Tj)  y(t-T2)  dTjdT2 


gj  ■  B2(xy)  (23) 

When  X  ■  y  we  have,  g^  •>  B2(^)  "  H,->(x^).  and  since  this  represents  a  real  input  into 
tlie  system  Hj, 

•  H2(*^)  ■  Hjtx]  (24) 

Terms  of  the  form  of  Rq.  24  do  not  occur  alone,  but  I')  combination  with  other  terr.ts.  If 
f  ■  H2[^'*'3']'  defln*  '.or  of  ii2, 

f(t)  ■  J yh2(Tj,  T2){x(t-Tj)+y(t-T2)}{x(t--T2)+y(t-T,)}  dljdXj 

*  f f  h(Tj,  T2>{x(t-T|)x(t-T2)+x(t-T|)y(t-T2)+y(t-Tj)x(t-T2)+y(t-Tj)y(t-T2)}  drjdr, 

(25) 

But,  since  h(T|.  T2)  is  symmetrical, 

f(t)  •>  J  J  h(Tj,  T2Kx(t-Xj)x(t-T2)+2x(t-Tj)y(t-T2)+y(t-Tj)y(t-T2)}  dTjdTj 

•  J dxjdTj  +  T2)*(t-Tj)y(t-T2)  dTjdTj 

+  y(<"Tj)  y(t-T2)  dTjdTj  (26) 
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.11  ti  '•ma  of  the  dcfinitlona  c.  Eqa.  'll  and  23,  Eq.  26  can  be  written 

f « +  zHjIxy)  +  Uziy^)  (27) 

This  expansion  of  ii2[)(i'y]  can  be  obtained  directly  <n  the  short  notation,  by  the  following 
sequence  of  steps; 

f  »  Hglx+y] 

=  a2((*+y)^) 

«  Hjlx^+Zxy+y^) 

■  Hglx*)  +  2H2(xy)  +  H2{y^) 
a  H2[x]  +  Zlijixy)  +  Hjty] 

and  this  la  validated  by  Eq.  27.  Thereby,  the  form  H2(xyl  ooours  In  combination  with 
other  similar  forms, 

Similarly,  for  the  third -order  case,  fj  ■  Bjfx+y]  ■  Hj((x+y)^)  «  ilj(x^+3x^y+3xy*+y*), 
or  fj  -  Hj(x*)  +  SHjtx^y)  +  3Hj(xy*)  +  Hjly*).  This  directly  generalises  for  the  n'**- 
order  case.  Not  only  is  this  a  useful  Interpretation  of  the  functional  operation,  but  it 
will  also  be  shown,  in  the  course  of  this  report,  to  be  extremely  useful  for  dealing  with 
inpukS  '  '>*  ■'xfi  oompoaed  of  sums  of  simple  functions  such  as  sinusoids.  Also,  this  is 
of  great  itn..wrianae  in  the  algebroi'-  ovnAucion  used  tor  determining  the  system  impulse 
responses  and  transforms. 

We  have  now  accomplished  two  aims; 

(a)  The  notion  of  functional  power  series  hnr'  l^ern  introduced. 

(b)  The  concept  of  non<  ;ear  operations  has  been  defined  as  generalised  multiplica¬ 
tion  operations  on  multiple  signals.  For  example,  Hj(xyB)  is  an  operation  on  a  triplet 
of  functions  x(t),  y(t),  and  z(t). 


2.  3  SYSTEM  COMBINATIONS 

There  are  three  basic  means  of  combining  nonlinear  system e  -  addition,  multiplloa- 
tion,  and  cascading.  The  addition  combination  of  two  systems  involves  putting  the  sanr.''^ 
input  Into  the  two  systems  and  combining  the  two  outputs  in  an  adder.  This  is  shown  in 
Fig.  8a  and  is  written  algebraically;  ■  J  ‘t  K,  where  L  is  the  combined  system,  and 
J  and  K  are  the  component  systems. 

The  multiplication  combination  is  similar,  uiioept  that  a  multiplier  is  cub'tltuted 
for  the  adder.  The  diagram  is  shown  In  Fig,  8b  and  the  combinution  is  written 

L  -  J  .  K  (28) 
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AOOiriON!  t'J'H 


<•> 


L*  J«R 


(»} 


CANa«oii  4*iHB 

It) 

Figi  8.  Syatem  oomblnktlonii 


III  yiiS'iii 

Fig.  9,  Illustrating  the  use  of  brackets. 

In  the  essoado  combination  the  output  of  one  syetenn  *b  the  input  of  the  other.  This 
is  shown  in  Fig,  8o  and  is  written  ^  ■  J  *  K.  Expressing  it  in  wordr..,  we  can  use  "plus" 
for  'H,  "times"  for  •,  and  "cascade"  for  "i.  Then,  for  example,  J  +  K  ,s  read,  "jay  plus 
kay." 

It  is  convenient  to  have  a  bracketing  operation,  in  addition  to  tb>j  vither  operations. 
This  is  used  to  remove  ambiguity  from  the  algebraic  expressions,  For  e?  i  mple,  the 
system  (J*K)  t-  L  is  the  cascade  syscem  J.  *  K  plus  the  system  L.  This  is  shown  in 
Fig.  9a,  However,  the  system  ^  is  the  system  J  cascaded  with  the  system 

(K+L),  This  combination  is  shown  in  Fig.  9b.  The  brackei-,  then,  has  the  same  grouping 
meaning  that  it  usually  has  in  algebra,  and  all  terms  in  psi-  jui/eses  sreclf.;  a  composite 
system. 


1’ 


(29) 


For  the  system  operation  '  Lf[x).  where  L  =  J  +  K,  we  can  write 


f  =  ('1+K)[xj 

Similarly,  if  L  »  J  •  B,  we  can  write 

f  >  ::*K)[x]  (JO) 

Equation  30,  however,  hen  another  form.  Lot 

y-Klx]  (31) 

Then,  by  the  definition  of  the  aaeoode  operation  (see  Fi(t.  Be), 

f-J[y]  (32) 

Substitution  of  Eq.  32  in  Eq.  31  yields 

f  -  J(K[x]]  (33) 

os  an  alternative  lorm  fur  Kq.  30, 


Now  that  we  have  the  baeiu  definitions  of  this  algebra,  we  shall  proceed  to  develop  it. 
In  view  of  the  addition  definition,  the  functional  representation  is  seen  to  be  an  expansion 
of  a  system  H,  and  oo  H  ■  H2  -t-  •  •  •  +  +  >  • .  > 

Now,  this  algebra  will  have  two  usest 

(a)  To  expand  a  system  in  terms  of  its  component  linear  and  nonlinear  no -memory 
subsystems. 

(b)  To  allow  block-diagram  manipulation. 

In  order  lu  es  1  A  Ss  «  ^h«s«  manlpuiwiions,  or  rearrangements,  oortsin  slgsbraio  rules 

must  be  developed.  For  the  addition  eoti  multiplication  operations  the  rules  are  similar 
to  those  usually  followed  in  algebra.  The  rules  for  the  ossoode  operation  are  somewhat 
different.  These  rules  will  bs  given  in  the  form  of  eight  axioms.  The  proofs  are  based 
on  the  physical  signifloanoe  of  the  algebraic  operatlcn'i. 

The  first  two  axioms  are  ounoerned  with  the  addition  operation. 

Axiom  1.  I  +  K-  K  +  i  (JA) 

This  combination  is  illustrated  in  Fig.  8a.  .Axiom  1  states  that  both  J  +  K  and  K  +  J 
stand  for  the  additive  oombinaticn  of  Fig.  Bs. 

Axiom  2.  j[  (B+L)  ■  (£+B)  *  L  (35) 

This  axiom  is  illustrated  by  Fig.  10a.  The  diagram  shows  that  1*  does  not  matter 
whether  K  and  L  or  and  B  grouped  together. 

The  next  two  axioms  are  like  axioms  1  and  2,  except  that  they  have  plus  replaced  by 
times. 

Axiom  3,  J  •  K  ■  B  *  i  (36) 

Axiom  4.  J  •  (K'L.)  ■  (J-K)  •  L  (37) 

The  diagram  for  the  axiom  3  combination  is  Fig.  Rb,  Axiom  i  states  that  both  J  •  K 
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J  •(»  "kl  •  li'JiBHk 


Fig.  10.  lUuatration  of  ■xloma, 


'•>  IJ'Bl'kMjiikl'tB'k) 


Pig.  11.  llluBtration  of  nxlnnia . 


anil  K  1  Btand  for  this  combination  F'j-ure  10b  is  the  diagram  for  axiom  4.  It  Hr^-s 
net  matter  whether  K  and  L  or  J  and  K  are  grouped  together, 

The  la.^t  axiotn  of  this  group  concerns  the  cascade  operation 

Axiom  5.  J  *  (K*L)  «  (J*K)  m  L  (38) 

This  axiotn  la  illustrated  by  Fig,  lOc,  where  it  is  shown  that  the  (  )  operation  has  no 
physical  signlfioanoe.  It  is  simply  a  matter  of  algebraic  uonveniencr. 

Then,  there  are  three  axioms  dealing  with  combined  operations. 

Axiom  6.  L  •  (J+K)  -  (L*J)  +  (L..JS)  (39) 

The  diagram  for  this  axiom  is  Fig,  1  is.  Axiom  6  is  true  because 

f  ■  x(y+t)  ■  xy  +  ya  (40) 

w.hsre  x,  y,  snd  s  arc  ths  outputs  of  L,  J,  snd  K,  respectively. 

A  similar  axiom  holds  for  the  plus  snd  oasoade  uomblnstior,. 

Axiom  7.  (i+K)  *  U '•  (I*L)  +  (41) 

This  is  shown  in  Fig,  llbj  the  two  systems  illustrated  there  are  equiva¬ 
lent 

Ai-iom  r  ^T.K)  *  e  (i*y  .  (5*y  (42) 

The  two  equivalent  systems  for  this  axiom  arc  shown  in  Fig.  llo. 

It  is  also  important  to  know  which  rearrangements  are  not  Isgltimcte.  In  particular, 
we  note  that,  in  general. 


Fig,  12,  Illustration  of  combtm  icns. 
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(43) 


J  *  K  K  *  J 

L  +  C+K)  (L*J)  +  (L-i-K) 

L  *  'J;K)  *  (L*J)  •  (L*K) 

Block  diacrama  (or  varioua  expreaalona  arc  given  In  Fig,  12,  and  thoso  ruiation,  will 
be  demonatrated  bv  meana  of  aimpie  oounterexamplea.  Let  j[x]  «  ax^,  Klxl  ■  bx^,  and 
L[x]  •  ox  ,  where  a*  b>  and  c  are  oonetante.  Then  (I'*'K)[x]  ■  a(bx  )  ■  ab  x  ,  and 
(K*J)[x]  b(ax^)*  ■  a^bx\  with  the  roault  that  (J*K)fx)  i*  (!S*J)[Jt]i  and  time  Eq,  43  la 
eatabllahed  in  thla  apeoial  oaae.  We  alao  have 

(Lf{J+K))[x]  •  o(ax^+bx*)^  ■  o(a+b)^  x^  (44) 

and 

((k*IK(ii*lS))i;i‘]  •  o(m“)*  +  o(bx*)*  »  c(a*+b*)  x^  (45) 

Since  Eqa.  44  and  45  are  not  equal,  Eq,  43  haa  bean  jjatlficd.  Now 

(L't'(J'K))[xl  ■  o(ax*‘bx*)*  ■  oa^b^x® 
and 

((L*J).(i,*S))[x]  «  o(ax®)®  .  o(bx*)®  -  o®a*bV 
and  ao  Eq.  43  le  valid. 

There  a.  '  .‘'"'•'ev'ir.  t'vo  Important  apeoial  oaaeai 
.il '"ISl  -Ki  •J-l  «6) 

and 

Lj  *  (J+K)  ■  (L,*J)  +  (Lj*K)  (47) 

Equation  46  ia  known  from  the  theory  of  linear  ayatema  (9).  To  prove  Eq,  47,  let 

i[*)  ■  y  («) 

and 

K(x]  .  ^  (49) 

then  (Lj*(J+K))[x]  ■  Lj{y+aJ.  But  Lj  la  a  linear  ayatem,  and  by  auperooaltion,  Lj[y+*J  » 
Lj[y]  +  Lj[e]<  Subatltuting  Eqa.  48  and  49  in  thla  expreaaion  givea 

or 

L,  ♦  (J+K)  -  (Lj+i)  +  (Lj*K) 
and  Eq,  47  ia  proved. 
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2.4  ORDEn  OF  SYSTEMS 


As  we  have  mentioned,  the  functional  representation  expands  a  system  H  in  a  series 

H  I.  called  an  n  -order  ey.tem.  and  H^[cx]  -  cX[*l.  where  x  la  the  Input  signal 

Tn  le  inrtZal  “““  differentiate,  between  the  term, 

in  the  functional  repreaentatlon)  that  1.,  the  ffr.t  term  la  linear  (first -order)  the  sen 

,T  Tr:  “« ■»  »■  ■> « ro. .  ...LTLZZ:. 

,  ^  ™‘*  ““  «•»  ■>.  l.k.n  ..  th.  ...ull  ol . 

sero -order  ayatem  with  the  property  that 

where  H  l.  ipeolfied  by  a  oonatant  h^.  However,  einoe  H  does  not  have  any  Input- 
outjwt  ralatlon.  we  shall  uaually  not  Inolude  It  In  th*-  funotlSn&l  oerles. 

so  that  a  combined  ayatam  oan  be  expanded  in  the  functional  aerie.  (Bq,  50).  the 
.ffeot  of  combination,  on  order  must  b.  noted.  The  ayatem  U.  with 

(51) 


contain,  both  n*^«,dm^^ord.^  part.,  ..  Eq.  51  .how. .  The  ayatem  K,  with 
K  ■  it_  •  B 

ti  .11 


(52) 


(53) 


la  a  ayatem  of  order  m  +  n.  Thla  order  followa  beoauae 
Kt««]  ■  A„l*>e]  •  B^tax]  - 
The  cascade  lystem  H,  with 

H  »  A„ • 

“H  -m 

la  a  ayatem  of  order  mn.  Thle  is  shown  by 

-  A„[fl^[«x]J  -  lt”'f  AJB  JxJJ  -  «“‘"H[x] 

In  which  we  have  used  the  alternative  coed,  definition  (Eq.  13). 

“**  “P®"  «*-rterlng  ha.  been  explained,  It  t. 

mlT  bI^T  *  ^  ^-t‘on.1  pc  Vno- 
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2.5  SPECIAL  SYSTEMS 


We  shall  now  introduce  the  notation  lor  sonoe  special  systems.  The  nonlinear  no¬ 
memory  system  will  usually  bo  denoted  by  IJ,  so  that  f  ^  N[x].  In  polynomial  or  power - 
series  form. 

rj  ■  Nj  +  Nj  +  ...  +  Njjj  +  ...  (54) 

and  then 

f  «  njx  +  +  . . .  +  n^x*"  +  ...  (55) 

A  particular  linear  no -memory  system  is  the  identity  system  J.  which  has  the  defini¬ 
tion  X  ■  l[x]. 

The  zero  system  fi  is  defined  os 

0  ■  fi[x]  (56) 

In  algebraic  equations,  0  will  be  used  to  denote  the  system  0. 

These  rather  obvious  properties  should  be  notedt 

H  +  ft  -  H 
and 

In  this  slgshre  it  '<  (Len  convenient  to  replace  the  nonlinear  no-memory  operations 
by  multiplication  operations.  To  do  this,  conoid  tr  the  term  *  H,  By  virtue  nf  the 
definition  of  N  given  by  Eqs.  54  und  55, 


n„x 

m 


m 


(57,' 


Now.  if  x«H[y|,  then  -  M„[ll[y]]  ■  (H„*a)ty].  »nd  from  Eq.  57,  N^[x]  ■ 

n„(H[y])"'.  By  definition  of  the  multiplication  operation  (Eq.  28)  of  this  algebra,  this 
procedui'V  gives 


m  times 


(58) 


Then,  if  we  define 


m  times 


we  have 

(59) 

where  is  jubt  gain  constant.  The  no-memn-'>  ‘.yrt -."1  h,„  has  boon  replaced  by  a 
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mu  It  ip  lie  at  iop  operation  thcr.hy,  and  a  sum  of  no-memory  systems  cun  bn  replaced 
by  a  sum  of  multiplication  operations. 

l.b  EXAMPLE  1. 

The  combined  system  will  now  be  illustrated  by  an  example.  Let  us  consider  the 
system  of  Pig.  13  in  which  L  «  *  N  *  Q^.  This  system  can  be  viewed  as  an  ampll- 


Fig,  13.  Illustrative  oasonde  system. 

fier  with  nonlinear  distortion.  and  Bj  are  linear  systsms  und  N  is  a  nonlinear  no¬ 
memory  system.  Let  N  have  a  linear  and  a  cubic  part,  so  that  N  ■  Nj  -f  Nj.  Then 

k  •  Ai  *  <Ni+EIj)  *  Bj 

and  by  using  axiom  7  (Bq,  41).  we  obtain 

L  »  Aj  *  (Nj*Bj+Nj*Bj) 

By  uee  of  bn.  4(,  ’-..tve 

L  -Ai  *Hi  *Bj  +Aj  *Nj  4B, 

When  and  Nj  arc  replaced  by  multlplioatlon  operations,  we  have 

k*Ai  *(niai)  +  Aj 

or 

L  •  OjAj  *  Bj  +  n^A j  *  bJ 

einoe  Aj  is  linear.  Now  L  ■  Lj  +  Lj,  where  Lj  ■  iijAj  *  Bj,  and  Lj  ■  HjAj  *  bJ. 

This  example  Illustrates  how  this  algebra  osn  be  used  to  doocribe  a  system  in  terms 
of  its  oomponont  subsystems.  Next,  we  want  to  relate  the  algebraic  representatUm  to 
the  system  impulse  responses  or  transforms.  Once  this  is  done,  we  can  proceed  to  find 
the  system  response  to  various  exoitstions.  But,  first,  two  other  topics  In  this  algebra 
must  be  considered, 

2.7  CASCADE  OPERATIONS 

Strictly  speaking,  the  cascade  operations  involved  in  lombinli.g  these  linear  subsys- 
temn  and  no-meivory  nonlinear  subsystems  will  not  Invoi  e  ujisoaUing  nonlinear  jystems 
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with  memory.  However,  algebr  simplification  is  often  obtained  by  grouping  a  number 
of  subsystems  to  produce  n  composite  subsj-tem  that  ts  nonlinear  and  has  memory  (see 
sec.  2.6  for  an  illustration  of  this  point}.  Thin  section  is  concerned  with  nonlinear  sys¬ 
tems  with  memory,  in  cascade. 

The  eas-ude  system  *  Bf„  has  been  shown  to  oe  of  order  mn.  Now  consider  the 
system  L,  tn  which 

(60) 


To  determine  the  order  of  this  system,  we  shall  develop  an  expansion  for  Aj 
Now 


-  (A,*(i^+S^))IxJ  a  A2[BJx]+S„[x]] 


Let 

y  ■  Bnt*l  <61a) 


*  "  Smt*] 


(61b) 


and  then 

y*]  ■  Ajly+aJ 

«  Ajfy*)  +  2A^(yT)  *  A^Cs*) 

Now.  subclHution  ol  Eqs.  bla  uij  6lb  gives 
y»]  ■  A2((i„[x))*)  +  2A,(BJx).C^[x])  ^  A,((C„[x])2) 
Then  if  we  define 


<A2°(B„.C„))[x]rA2(B^[x).C„[x]) 
with  the  use  of  the  operation  "o",  the  system  L  beoo.nes 

fA2«(B2)+2A2  0(B„.CJ  +  A,o(c^)  (62, 

(Note  that  Aj  0  (bJ)  a  Aj  -BnO 

Now  that  E'q.  62  has  been  established,  we  see  that  it  ck.  be  quiculy  obtained  from 
Eq.  60,  as  follows. 
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-A2o(a2+2g^.C^+Cy 

’■A,o(g2)  +  2A2  0(8^.C^)  +  4^o(gy  (6,) 

The  term  ^2  ®  (B^'C^)  !■  «i  operator  ol  order  m  +  n  beceuae 
(A20{B„-C„))I«x]  -  A2(B„[cx1.C^[£x1) 

-A2(£”^“B„[>‘)‘emI*j) 

-*“'^*‘A2(B„[x].C„M) 

-e'®+®(A20(B^.C^))[x]  (64) 

Therefore,  Eq.  63  ahowa  that  ^2  *  (B^t-C!^)  oan  be  expanded  Into  three  operatora  of 
order  2n,  m  f  n,  and  2m. 

The  oaae  *  (B^‘*‘C,n^  expanded  In  a  elmilar  nmanner: 

A3  *  (in+fimJ  ■  Aj  «  (8„+C^)’  -  Aj  o  (b»)  >  3A3  o  (gj.g^) 
"JA3®(B„-c5,}.H3u(cfJ 
where  Aj  o  ia  of  order  2n  +  m,  ana 

(Aj®(Bil.sJ[x]-A3{§;,xJ.C„(xj) 

Thia  exponaion  of  the  ooacade  operation  oan  be  generallaed  to  any  order.  For 
example, 

Aa  •  <VCm+-  •  •  r)  *  A,  ®  <B„*C„4. . . 

and  haa  a  typioal  term  In  Ite  exponaion; 

Aa^Jn'C^’--^ 

a  terma 

whloh  ia  of  order  n  +  m  +  . . .  . 

In  thia  manner,  a  caaeade  somblnatlon  of  syatema  can  be  apllt  up  Into  a  aum  of  alngle 
operatlona.  Each  of  theae  simple  operations  has  a  sin^’le  transform  of  Impulse  response 
oi^isoeiated  with  it,  whicli  will  be  given  later. 
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2.8  I'iSUOBACK  SYSTEMS 

Example  1  was  for  a  feed-through  eyatem.  Therefore,  obtaining  Ite  functional  expan- 
alon  waa  a  atralghtforward  procedure.  We  shall  now  develop  the  procedure  for  deter¬ 
mining  the  funotional  expanaion  for  a  feedback  ayat'im.  The  single -loop  feedback  system 
is  shown  ii,  Fig.  14a,  in  which  ^  and  B  are  nonlinear  systems  th.at  have  a  known  func¬ 
tional  expansion.  Figure  14b  is  an  equivalent  system,  in  which  the  feedback  system  of 
Fig.  t4a  has  been  split  into  the  system  A  cascaded  with  a  simpler  feedback  system. 


«i 


Fig,  14.  (a)  Nonlinear  feedback  system,  (b)  Equivalent  system. 

(o)  System  (d)  Combination  of  A  and  L. 

Lst  S  *  A  *  !!•  Md  let  the  simpler  feedback  system  be  denoted  explicitly  by  L,  as 
shown  in  Fig,  14o,  Then  the  feedback  system  of  Fig,  14a,  which  is  explicitly  denoted 
by  K,  is  given  by 

S  »  A  ♦  L  (65) 

as  shown  in  Fig.  14d.  Since  A  is  known,  K  can  be  obtained  from  Eq,  6*.  once  L  has 
been  determined.  We  shall  determine  L  first  and  then  find  K  from  Eq.  65,  because 
this  is  easier  than  developing  K  directly.  (In  many  problems  K  can  be  found  directly. 
In  this  general  case,  such  a  procedure  is  diffiouit.) 

F'or  the  feedback  system  L,  output  g  is  related  to  inf  .  by 
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g  =  x  +  H[g]  (Ob) 

which  relates  g  Implicitly  to  x.  However,  it  is  desired  to  have  an  explicit  relation 


p  «  Ii[*] 

and  so,  if  we  substitute  Eq.  67  in  Eq,  66,  we  have 

L[*J  ■  X  + 

Writing  this  as  a  system  equation,  we  obtain 

!ri“I+H*L  (68) 

where  1  is  the  identity  system.  Equation  68  is  an  implicit  equation  for  L.  Now,  we  have 
assumed  that  A  ■  +  ^2  ’*' '  *  ‘  *  "n  *  ' "  B  “  Si  §2  5n  ‘ 

the  expansion 

H-Si +H2*“-~Hn*  ••• 

ic  known,  sinoe  H  ■  £  *  ^ . 

Now,  we  desire  to  find  L  in  the  series 

t  "  ki  +  i<2  + -•  +  +  ...  (70) 

Therefore,  Eqs,  69  and  70  are  substituted  in  the  system  equation  (Eq,  68),  and 

+L2  +  Lj+  ...-l  +  (Hj+H2+K3t,,,)*(Lj+L;2+L3+. ,,)  (71) 


th 

No«  1!  ren  he  fo"nd  in  terms  of  the  by  equating  the  n  -order  system  on  the 
left-hand  side  „.  £q.  71  to  the  n^^-ot-d..i  ayalem  on  the  right-hand  side.  So  that  the 
order  can  be  recognised,  Eq.  71  must  be  expanded  as  follows! 

+  La  +  4-3  +  <••  •!+  (Hi*4si+Si*ii2+iii“'L’^+-'*) 

+  (B2°(l?)+2H20(l,j.L2)+H2‘»(l2)+.  . .) 

+  H3o(l|)+...)+... 

Equating  equal  orders  then  yields: 


Lj  ■  I  +  H,  *Lj  (72) 

L2  »  Hi  *  42  +  Hj  o  (lJ)  (73) 

Lj  ■  Hj  *  I,J  +  ZHj  «  (Lj.Lj)  ♦  Hj  ‘>(^1)  (76) 


and  so  on. 
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By  way  of  explanation,  if  y  =  A[xJ  and  z  -  -y,  then  z  -  -A[xJ,  Now,  if  g  =  B[x],  then 
f  a  g  +  1  »  b[x]  +  (-A[*])-  Taking  f  a  H[x]  «  B[x]  +  f-A[x])  given  a  Byatem  equation 

H  a  B  I-  (-A)  or  H  a  B  -  A 

This  definet  the  minus  sign  in  this  algebra.  The  minus,  or  subtraction,  operation  obeys 
all  the  rules  for  the  addition  operation.  Thus  by  subtracting  *  Lj  from  both  Hides  of 
Eq.  7Z,  we  have 

kl  -  (ai*Li)  »  i  t  -  (ni*hi) 

or 

Lj  -  (HjfLj)  a  I 
or 

(75) 

because  I  *  Lj  a  L^.  Equation  7‘>  la,  then,  an  alternative  form  of  Eq,  72.  In  a  similar 
manner,  Eq.  73  becomes 

(I-Sl)  *1,2  •H2'»(Li)  (76) 

and  Eq.  74  becomes 

(I-Sl)  *  t!3  “  ZHg  O  (li,.L2)  +  H3  (77) 

Now,  if  Vks  '  ''a'. .ade  Eq.  75  (formal  justification  will  be  given  in  Sec.  VI)  by  the 
Inverse  of  (I-H^),  which  Is  denoted  (1-Hj)~\  th-‘n 

(1-Hj)“‘  a  (NHj)  •  Lj  a  d-Hj)"*  (78) 

But  (I-Hj)“*  is  the  Inverse  of  l‘”Hj),  and  so  (l-Hj)“^  f  (I-Hj)  »  I,  and  Eq.  78  becomes 

L,  a(l-Hj)'‘  (79) 

(If  y  a  £[[x],  then  there  is  a  j|S  for  which  x  •  l![y].  This  K  i*  the  inverse  of  H  and  we  shall 
denote  K  by  H~^.  The  inverse  is  considered  ir,  more  detail  in  sec.  6.  3.  The  Inverse 
of  a  linear  system  is  well  defined  in  linear  theory.) 

Similarly,  Eq.  76  becomes 

hz  -  (l-Hi)*‘  ♦  Ml])) 

and  Eq.  77  becomes 

Lj  a  (l-lli)"‘  *  (zH20(Li.L2)+H3o(lJ)) 

In  this  manner,  <he  can  be  found  for  the  feedback  sj"  ri>  ij. 

The  funoti;  ,uJ  series  for  the  feedback  system  K  ;s  th  m  given  by 
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K  =  A  ♦  L 

»  (Aj+A2+...)  *  (I-1+L2+---) 

=  Aj  *  Lj  +^2  '’(Li)  +  2A2‘>  (Li-tz)  +A,  o  JlJ)+  . 


and  tht'.^ 

Kl=Ai*Li  (80) 

K2-A.2‘>(lJ)  (81) 

lij  -2^2  0  (Lj-Lz)  +430(1,3)  (82) 

and  10  on.  The  validity  of  the  aeries  expansion 

jC -Kj +K2  +  ... +Kj+ ...  (83) 


will  be  oonaldered  In  Seotlon  VI.  but  It  may  bn  said  now  that  It  la  generally  rapidly  con¬ 
vergent  for  sufficiently  bounded  input. 

In  any  partioulix  problem  there  are  two  alternatives.  We  could  use  the  equations 
for  for  the  general  case  of  Fig.  14a  (the  first  three  equations  are  Bqs.  80,  81,  and 
82),  and  substitute  the  particular  A  ^nd  g  that  are  being  used,  A  better  procedure  la 


rig.  IS.  Nonlinear  servo  system. 

to  work  out  the  by  the  method  just  described,  for  each  particular  case.  This  Is  not 
too  difficult  after  some  practice. 

As  an  example  of  this  method,  consider  the  feedback  system  of  Fig.  IS,  In  this  case 
L  «  Hj  *  N  *  (l-L)  (84) 

where  is  a  linear  system,  and  N  Nj, 

This  system  Is  sufficiently  simple  that  the  series  for  L  cun  bo  obtained  directly. 
Equation  84  can  be  rewritten  as 

\ 

L  -  Hj  •  (I-y  +  njH,  *  (I-L)^ 

and  substltiitfon  of  the  aeries  ■  1^]  't  L2  +  ky  +  "  -  ‘  expresslu'i  yields 
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L j  +  1-2  ^  t;3  •  • 

•={?]'*  (l-ki-.kz'kj----)  +  ♦  (I-Lj-L^-Lj-.  . 

=  (Hi*(l-kl)-H|*L<2-Hi*L3-. .  .) 

Therefor® 

+  (n3Hje(i-Lj)^+3n3Hj*(a-L)^*L2)+. . .) 

(85) 

L,  •H,  *(I-ki) 

(86) 

kz  -  -Hi  *^2 

(87) 

Lj  ■  -Hj  *  Lj  +  n 

jH,  *  (1-y^ 

(88) 

R««i  ranging  Eq.  86  (in  •  manner  almilar  to  the  rearrangement  that  gave  Kq,  79  from 
Eq.  72)  yield! 

fel  ■  (l+Si)"'  *  Hi 


Equation  87  la  satlafled  for  eolutlon  (aee  aeo.  6,  3).  Rear' 

rangement  of  Eq.  88  given 

Lj  ■  njd+H,)"^  •  H,  •  ■  hjiij  *  (l-Lj)* 

Continuing  thla  procadura  given  L^,  and  ao  on,  In  particular,  it  can  be  ahown  that 
"  0 

Lj  ■  JHski  *{a-in)**k3) 


hy  ■  njL,  *  (3(1-L,)-L*  )  +  ) 

2.  9  IMPULSE  RESPONSES  AND  TRANSFORMS 

It  han  been  ahown  how  the  algebra  of  ayatema  can  be  uaod  to  combine  ayatema.  But 
before  the  output  of  a  ayatem  ao  deaoribad  can  be  obtained  for  aorne  given  Input,  thla 
algebra  munt  be  related  to  the  ayetem  impulae  reapo.iaen  and  tranaforma.  We  ahall 
give  the  relation  between  the  algebraic  terma  and  the  correapondlng  impulae  reaponaes 
and  tranaforma. 

By  meana  of  thla  algebra,  a  ayatem  h  le  expanded  in  a  aerlea  L  =>  Lj  +  L2  t-  . , ,  + 

L^  +  ,,,,  where  the  L^^  are  given  in  terma  of  the  nyatem'a  component  aubayatema. 

For  an  n'** -order  term  of  the  form  L„  ■  A„  +  B_  or  L^lxi  «  A_[xl  (•  B^fxl,  the  oorrc- 

—n  -n  ~n  —n^  ••n''  '  — n^  ^ 

aponding'  functional  equation  la 
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f-'-f  ’n<^l . ■■■ 

“  /•••/  V"l . ■r„)*(t-T,)...  x(t-T„)dTj  ...  rtr^ 

+  J...  j'b„(T, . T„)x{t-T,)...  X(t-T„)dtj  ...  dr„ 

*  /  ■  ■  ■/  . ‘*^1  ■  •  •  '*^n 


Therefore 

V"l . ^n>"  . 

Henooi  for  the  elc^braio  term  where  +  B^,  the  oorreeponding  ImpuUe 

reeponae  ie 

. *n^  ■  *11^*1** ••*V  *  V*r'“’ V 

The  aorreepondlng  treniform  relation  la 

^n<*l . V- V*1 . *0)  + V"l'‘“-*n> 

Similarly.  It  oan  be  ahown  that  for  the  aimple  multiplloatlon  combination,  with 
-n+m  '  '  ^'n'  oorreeponding  Impulaa  reeponae  ia 

*n+m^*r”"*n+m^  "  “n^^l*  ***' V ”  "'n+m^ 

The  oorreeponding  tranaform  la 

'-n+m^*! . ■n+m>  "  . 'n^  ®m<*n+l . 'n+m^ 

For  the  oaaoade  altuation,  witii  *  S„>  the  impulae  reeponae  ia 

‘n<*l . *n>  •  . 

and  the  tranaform  ia 

. 'nJ  •Ai(aj+a2+...+a„)B„(aj . OH 

The  more  general  caacade  operation  alao  haa  a  relation  with  a  oorreeponding  Impulae 
reeponae  and  tranaform.  If 

W...+r--\"<6p%--?r)  (”> 


then 


(94) 


. W^z)  •••  <^"1  ■••  ^’n 


,,...,  t  -T. ) 

1  '  n  I ' 


J  p+q+.  .  .  . ‘'pHq+. . .  +r>  *  V*l+‘  *  ‘  +•?'  ®p+l  ' '  +»ptq'  '  •  > 

XV*1 . VSVl . W”' 

Some  of  these  combined  /orme,  ae  written,  are  not  oymmetrioal,  but  they  can  bo 
symmetrized,  if  it  le  desired.  As  we  have  stated,  the  impuleo  response  h^l'.^tj)  can 
be  symmetrized  by  forming 

h2(ti.t,)_tha(t,.t,) 

The  transform  H2(s^,  S2)  can  be  symmetrized  by  forniing 


Similarly,  for  Hj(S|, Sj, s^).  we  oan  construct 
^  |,Sg,  S^)+H^(S|,Sj,  S2)'^Hj(s2,  S2*  s  I  )+H2(s2,  Sj,  Sj) 

S|,  S2)‘^H2(s2,  S21  S|)} 


In  genertl,  for  H^(a ^, . . . ,  s^^),  wo  add  up  the  with  nil  possible  arrangementu  of 
S|,  , . . ,  s^^  and  divide  by  the  me  'bsr  of  ..rrangements, 

Two  examples  of  obtaining  the  transforms  from  this  algebra  will  be  given.  For  the 
feed-through  system  (see  Sea.  VI)) 


L  ■  Lj  +  Lj 

(99) 

Ll  'niAi  *B, 

(100) 

L3  ■  HjA,  ♦  bJ 

(101) 

Let  have  a  transform,  A|(s},  and  have  a  transform,  B|(u).  We  want  to  find 
L.j(s),  the  tranoform  of  and  Lj(S|,  S2.  Rj),  the  transform  of  Lj,  application 
of  Eqs.  89'9S,  we  have  L|(s)  >  njA|(s)  Bj(s).  From  Eq,  VO,  haa  e  transform, 
Bi(s,)B,(s2),  and  B,  -  B?  •  Bi  has  a  transform,  BjCsj)  Bi(*2^  lj>j(s)>  Equation  VC  then 
shows  that 

Lj(ij,  Sy,  ■  njAj(aj+B2+Sj)  Bj(ej)  Bj(r2) 
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The  Stfcoiid  syattm  n  an  •  vtTiple  ol  a  feedback  system  (sec  sci;.  2.  8),  with 


v-1 


Li  (i+Hi)  *  Hi 
Ly  «  hsLi  * 

Ls  =  3n3k,  *  ((l-kZ-yy 


(H»2) 

(103) 

(104) 


Let  H,  have  a  tranaform,  H^(a)  ■  where  A  »  s.  Then  (L'l'iii)  has  a  transi'orm 


I  + 


)A±Ji 


s  -)■  a  M  +  a 

and,  from  linear  theory,  we  know  that  has  a  transform 


1  +  H,(a 


■  i±« 
a  +  A 


Then,  from  Eq.  92,  L^  has  a  transform 

f  /■!  f  ■  t  a  A  o  -A 
^1'*'  a  +  A  s  +  a  s  +  A 

Since  (lrk\)  has  a  transform  I  -  L|(s)  **  s/(s'fA),  (1-^^)  has  a  transform 


(105) 


from  Kq.  90,  ..lo  has  a  tranefoi-.-.i 


B|  +  A  Sj  +  A  ij  +  A 

Therefore,  appiloation  of  Jq,  92  to  Eq,  103  ahowa  that  Lj  haa  a  transform 
I  V  ”3^  *1  *2  *3 

^3'*1'“?.**3^  "  aj  +  aj  +  Sj  +  A  Sj  +  A  s^+TC  Tj  +  A 
2 

Alao,  ainoe  (I-L^)  •  has  a  transform 
■^7+ A  i7+^  ^3<*3**V“5> 


(106) 


Lj  (Eq.  104)  has  a  transform 


. 's’  *  -5  + A  T;h  ^3''*3-  '4'  -s' 


(107) 


With  some  experience  the  transforms  can  be  readih'  obtained  by  inspection  from  the 
ulRebraic  equations.  We  are  still  not  in  a  position  to  i,  j  these  trauBfor-'tis  to  compute 
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the  eyetein  output  for  a  given  i<.tJUt.  However,  at  the  end  of  Section  III,  these  trans¬ 
forms  wilt  be  used  for  this  purpose. 

2.  10  SUMMARY 

We  have  oeen  concerned  with  expressing  nonlinear  systems  in  terms  of  their  linear 
Bubsyetems  and  nonlinear  no-memory  subsyetems.  The  main  tool  for  combining  qvs- 
tema  has  been  an  algebra  of  systems.  The  algebraic  tnauipulations  required  for  system 
combination  obey  laws  similar  to  those  of  other  algebras.  If  the  algebra  of  systems 
were  not  used,  system  combination  would  have  to  pmneed  with  involved  formulas  and  by 
a  series  of  clumsy  steps.  Our  algebraic  notation  consists  of  a  system  representation  in 
which  only  those  aspects  of  the  funntion.al  representation  that  are  involved  in  system 
combination  are  emphasised.  This  algebra  applies  the  powerful  concepts  of  operator 
mathematloB  to  nonlinear  systems. 

The  relation  between  the  algebraic  representation  and  the  system  impulse  responses 
and  transforms  has  been  shown.  Partloular  empnasis  has  been  placed  on  the  transforms 
in  the  two  examples  presented. 


HI.  SYSTEM  TRANSFORMS 


3.  1  INTRODUCTION 

We  Uave  represented  a  nonlinear  system  in  terms  of  its  impulse  responses 
ht^(tj, . . , ,  tn),  or  the  transforms  8|^).  1  he  system  output.  f(t),  is  ^.ven  by 

Eqs.  Z  and  3,  The  problem,  now,  is  to  obtain  the  f„(t),  and  thereby  the  system  output. 
f(t). 

In  Section  I  multidimensional  transforms  were  introduced,  and  we  found  that  the 
value  of  these  transforms  -  Just  as  in  the  linear  ease  -  lies  in  their  making  it  possible 


Fig.  16.  Illustrative  feed -through  system. 


to  substitute  multiplications  for  convolutions,  Not  only  is  this  true  in  calculating  the 
system  output,  but  also  in  cascading  systems.  This  is  shown  by  Eqs.  91  and  92,  and 
by  Eqs.  94  and  95. 

Another  reason  for  using  transforms  is  that  the  form  of  the  impulse  responses,  even 
for  slmr'^  svstems,  is  rather  complicated.  For  example,  consider  the  system  of  Fig.  16. 
In  this  case. 


L  ■  Lj  »  Bj  *  Njj  *  Aj 


and  Aj  has  a  transform  A/(s+o),  Bj  has  a  transfi  ■m  B/(s+P),  and  n^  ■  1.  Thrrefore, 
from  Eqs.  90  and  92,  ha>  .<1  transf.’rm 


L,2(Bj, 


A^B 


(Sj+Sj+PKSj+oXSjks) 


(108) 


Reference  to  Eqs.  89  and  91  shows  that  the  impulse  response  is 


‘2(‘l-V“/o‘ 


t.ort,  2  -a(tj-T)  -a(t2-T) 


Be 


-pr 


A-c 


dr 


for  t|,  t2  >  0.  since  A/(s'*-a)  has  an  inverse,  A  exp(-at},  and  B/(sfp)  has  an  inverse, 

B  exp(-pt).  The  form  of  the  limit  follows  because  A|  and  Bj  are  realizable  systems, 
and  T  is  integrated  from  0  to  t|  or  tj,  whichever  is  smaller.  Working  out  the  integral 
gives 


1 


2^*1' 


BA^\ 

P-Zu/ 


for  tj,  t.,  a  t  rtiid  tj  ^  tg,  and 
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(109) 


1  , ,  12)  = 


-nt 

e 


1 


i\-.v  Ij,  »  0  and  tj  <  tj.  Comparing  this  result  with  Eq.  108  shows  the  simplicity  of  the 
ti  anoi'orm,  as  compared  with  the  impulse  response 

Our  obji  ct,  now,  is  to  show  how  the  transforms  can  be  used  to  determine  the  output 
o(  a  system.  Emphasis  will  be  placed  on  an  important  special  case  for  which  the  irans- 
iorms  are  factoriznble.  This  situation  arises  when  a  nonlinear  system  is  lumped. 

We  shall  be  in  a  position  to  apply  the  functional  representation  to  the  solution  of 
nonlinear  system  problems,  and  several  examples  will  be  given. 


3.Z  MULTIDIMENSIONAL  TRANSFORMS 


Higher-order  transforms  were  defined  by  Eqs.  10  and  11,  and  a  method  of  using  the 
transforms  was  indicated.  The  linear  oaae  is  well  known.  If 

fj(t)  "  J*  hj(T)  x(t-T)  dr  (110) 

then 

Fi(s)  •  Hj(s)X(s)  (111) 


Consider  jystem 

f2(t)  ■  jy  h2(Tj,  Tj)  X(t-Tj)  X(t-Tj)  dTjdT^  (IIZ) 

To  use  transform  theory  here,  w«  must  artificially  iui.  ocluce  a  tj  and  a  t2i  so  that 

f(2)(‘li*2)  ■  jj*  h2(Tj.  T2)  X(tj-T,)  x(t2-T2)  dTjdT2 

and  then 

F(2)(»i.e2)  "“e(*1-*2)  X(Sj)X(s2)  (113) 

Formally,  at  least,  P'{2)(ei<e2)  oould  be  inverted  to  give  f(2j(ti,t2J' 

the  desired  output,  f2(t)  »  f^2)(^*0*  This  is  illustrated  In  Fig.  17.  We  have  f2(tj,  tj), 

which  could  be  plotted  by  contours  on  the  t^,  t2  plane,  but  we  are  only  intfirested  in 

along  the  45*  line  where  tj  a  t2  ^  t.  This  method  generalises  to  nigher-order 
cases.  For  example. 


f(3)(t,,t2,t3)  rJJJ  h3(Tj.T2.Tj)  x(tj-Tj)  X(t2-T2)  x(  -T  ,)  dTjdtjdTj 
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(114) 


but  th  quantity  of  Interest  la  f^ft).  with 
fjd)  =  f(3)(t,t,t) 

The  procedure  of  taking  a  munb.;  of  variables  tj,  .  .  .  ,  t^  as  equal  will  be  called 
"associating”  the  variables.  The  procedure  that  has  been  outline!  is  not  particularly 


Fig,  17.  (t^.tj)  plane  showing  t|  3  tj  line. 


praotlcal,  since  it  involves  taking  an  n-dlmenslonal  inverse  transform.  A  better  pro¬ 
cedure  It  to  aaaoctate  the  time  variables  In  the  transform  or  frequency  domain.  That  la, 
given  *2^  transform  of  tt'ansform  of  f^(t),  will 

be  found  directly  from  F2(*i>*2)‘  formal  relation  it> 


F^2)(a-u.  u>  du 


(115) 


where  v  la  a  suitably  ohoien  real  number.  A  proof  Is  glvsn  in  Appendix  A,  2.  This 
rslatlon  is  similar  to  tha  Raal  Multiplication  Theorem  of  llnoKr  theory  (9).  For  higher- 
order  traneforma,  Eq.  115  can  be  applied  suooasstvely  to  assoolata  the  variables,  two 
at  s  tlmv,  ihe*"  \,r  example,  for  Sj,  s,), 

,  .  v2  /•  e+J«  f  e+jie 

F(2j(r-u,.u,-U2.U2)du,dU2  (116) 

Thta  is  still  not  very  pr-'ctioal  because  convolutions  must  bs  made  In 'the  transform 
domain.  The  great  value  of  making  tha  aaaootatlons  In  the  transform  domain  lits  in  the 
fact  that  thass  asaoelations  ean  be  made  by  'nepeotlon  In  a  large  class  of  problsma.  This 
olsss  Is  the  nonlinear  genarsltsatlon  of  the  linear  situation  in  which  tiie  transforma  are 
faotorlsable.  Tha  constraint  on  the  aystem  Is  that  it  bs  lumped  that  Is,  that  all  the 
transforme  of  the  linear  aubayatsma  be  faotorisable, 

Thtn  for  the  lyatem  H,  where  H  «  H,  +  H,  l-  . , ,  4  +  . . . ,  we  Itave 

imm  M  M  I  ***11 


wliere  P^,  p^,  and  Rj  are  complex  constants.  This  is  familisr  from  linear  theory,  and  note 
that  terms  of  tha  form  P^/(e+Pj)”,  for  n  >  1,  have  been  left  oti^.  Such  terms  wUl  bs  con¬ 
sidered  separately.  If  X(a)  la  the  transform  of  the  Input  to  H,  then  the  transform  of  the 


i 


H 


output  from  the  linear  portion  U  given  by  F|(b)  =  Hj(b)  X(b).  if  Y(b)  Ib  factorizable, 
then  it  in  known  from  linear  theory  ‘hat  F^ls)  nae  the  same  form  a*  Lq.  117,  if  multiple 
order  poleB  are  neglected.  In  the  cIbbb  of  ayst^mB  that  ia  being  studied  (linear  suhays- 
teme  with  memory  and  nonlinear  no-memory  Bubayatema)  the  moat  ger.eral  second -order 
term  la  a  aummation  of  terms  of  the  form 

The  determination  of  the  transform  of  such  a  term  was  considered  in  Section  U.  It  if' 
A|(s^'ia2)  B|(aj)  C|(s2) 

where  Aj(a),  B^(a),  Cj(s)  are  the  transforms  of  the  systems  A ^  gj^,  and  gj,  respec¬ 
tively,  If  the  input  has  a  transform  X(s),  then  the  contribution  to  the  system  output  that 
la  attributable  to  the  output  from  the  term  of  Eq.  118  has  a  aecond -order  transform 

Aj(ai+B2)  Bj(Sj)  C,(S2)  X<aj)  X(s2)  (119) 

Ifaj(a),  Cj(a),  and  X(s)  are  of  tne  same  form  as  Eq,  117,  then  Bj(B|^)  X(cp  and 
C|(a2)  X(e2)  have  thU  form,  and  Eq.  119  becomes 

Ai<-i+-2)Ij;\i;^  (‘20) 

where  B|,  Cj,  and  are  complex  constants.  The  transform  Aj(s)  does  not  tmve  to 
be  fsctorlsable,  but  it  will  generally  be  assumed  to  be  so,  Note  that  the  terms 


!v‘ 

i«b  ‘ 


hav«  been  exclu-ied  fro—  ..i,  summation  of  Eq.  120.  This  Is  done  bcuause  these  terms 
are  the  transforms  of  Impulaae,  doublets,  and  so  forth,  and  such  funotlone  do  not  exist 
when  squared,  Should  these  Idealizations  occur  In  a  physiual  probleni,  they  must  be 
removed  and  replaced  by  the  real  physical  signals . 

The  inspection  technique  can  now  be  developed.  Cu  'rider  a  typical  term  in  the 
second -order  case  (Eq.  120): 

*^(2)(*l*  ‘2)  *  Aj(sj+S2)  a  Sg^  y 

Application  of  the  transform -domain  association  equation  (Eq.  lib)  gives 

^2(*)  ■  2^  /  Q(2)(»-'‘*'*) 


(121) 


or 


J*A,(e-u+.i)^,»^p^du 
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The  ‘erm  that  U  to  be  considereci  Is 


)■  r  B  c 
2itJ  J  b  -  u  +  ^  u  +  Y 

But  (B/(8 j+|3)(C/(s2+y))  ia  easily  inverted,  and  has  an  inverse  transforiii 
“3t I  “^^2 

Be  ‘  Ce  tj.tj  >0 

Setting  ^  gives 

B  t  *  0 

This  has  a  transform,  BC/[Bi-(P4-Y)1i  and  it  is  seen  that 


„JL  C _ B  C  ^ _ 1 

2vj  j  s  -  u  +  p  u  +  Y  + 


BC _ 

►  (P+V) 


Finally,  we  have 
OjCs)  .  Ai(ii)  — 

*  ‘  *  + (P+v) 

where  Qjia)  ia  the  transform  of  where  g|2)(tl>^2^  Inverse 

transform  of  0^2}(*|>*2)>  we  have  made  the  association  of  tj  and  t2  by  a 

transform  dcmai*  ■  ■iulpulatlon  that  gives  us  the  ordinary  linear  transform  of  the  desired 
time  function  g^d).  Furthermore,  this  manlou'ation  can  be  done  by  inspection. 

That  it  is  an  inspection  technique  is  seen  by  noting  that  the  association  of  tj  and  t2 
changes 

*2^  "  “n  tl  TTT  (124) 


r“2'  b,T?  S2  +  Y 


Gjis)  »  Aj(b) 


e  +  (P+y) 


Examination  of  Eqs.  124  and  12S  shows  that  the  change  is  a  very  obvious  one  and  cm  be 
obtained  by  inspection. 

Higher -order  trantforms  can  be  reduced  bv  applying  the  inepuction  proced'.’.re  to 
associate  the  variables,  two  at  a  time.  For  example,  consider  the  third -order  term 


A _ _B _  C  __C__.fi _ 

Sj  +  aj  +  +  a  Sj  +  Sj  +  ?  Sj  +  Y  +  Y  1*3  +  \ 

Application  of  the  formal  aaaoctation  equation  (Eq.  US)  to  aeeocUtc  s,  and  a.  yielde 
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1  /*  _ A _ B _  _C _ C_  C  . 

+  Bj  -u +u  +  a  Sj- u  u  +  plj  +  Y  Sj  -  u  +  V  u  +  y 

. _ A_ _ B _ C__L  _ c _ 

8,  +  8^  +  O  Sj  +  P  •,  +  Y  Zifj  Bj-ut-YU  +  Y 

This  Integration  1b  of  the  BBme  type  bb  that  In  Eq,  122,  and  It  yields  C/(o,+2v'  (see 
£q,  123),  Therefore  Eq.  127  beeomeir 


Bj  +»2  +  «  Bj  +  YB2  +  ZY 

(For  oonvenlenoe,  the  prooedure  of  aasooiatlng  two  time  variables  t^  and  t^  in  the  fre¬ 
quency  domain  will  be  called  "aaooclatlng''  the  frequency  variables  b^  and  b^.)  The 
change  from  Eq,  126  to  Eq,  128  1b  obtained  by  applying  the  inepectlon  technique  to  the 
varlablea  Sj  and  s^.  Now,  Kq.  126  equale 

_ A _ g_  _ !_].  (12, 

Bj  +  Bj  +  a  B,  +  Y  z« -P^B2  +  P  Bg  +  2yJ  ' 

and  the  BBBOoiatlon  prooedure  can  be  applied  to  aaeoclate  Bj  and  Bj.  The  result  la 


BC^  A  r  1  1  1 

^^=^1«  +  {P+Y) 


Slm<'«riv,  a  transform  of  any  order  can  be  reduced  to  a  first-order  transform  by 
BuccesBlvc  use  o'thw  .uspectlon  technique.  For  example,  consider  the  fourth-order 
term 


Ki(ei+B2+B3+B^)  jpp-j— ^  (1 

where  Kj(b)  la  some  transform  function.  ABSoolsting  Bj  and  b^  by  Inspection  yields 


gj  +  Bj,  +  a  Bj  +  p  *2  +  p  Bj  +Ty 

Next,  aasoulate  Sj  and  82.  The  result  la 


B _ B 


If  f.  4,.  »  A—  B  C* 

''l'*2**3'  Bj  +  u  Sj  B3  +  2y 


«  Ki(*2+»3)  2^?a^Bj,  +  «’'*«2  +  Zp)  gj^  2y 
Finally,  and  Sj  con  be  associated,  and  we  obtain 
'^l'*'  2p  -  u  ^B+a+2Y  B+2pt-2ay 
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Notice  that  and  were  aesoclatcd  firat,  then  and  ■2<  finally  e^  and  a^.  If  wc 

had  neeociated  and  a^,  and  s^,  and  82  and  ij,  we  would  have  hud  to  handle  .1  form 
that  had  not  been  diacubsed.  At  times  when  we  are  using  the  inspection  technique,  It 
will  he  neceaaai'y  to  aeeociate  the  variables  in  a  definite  order  to  avoid  forma  that  v/e 
cannot  handle  with  the  muthod  discussed  here,  In  a  similar  manner,  fifth-,  sl\th-, 
and  higher -order  transforms  can  be  reduced  to  fu  st -order  transforms. 

Tho  method  for  using  multidimensional  transforms  can  bo  summarized  as  follows! 

(a)  Introduce  artificial  variables  t|,  t2,  t^,  so  that  multidimensional  trane- 

forms  can  be  used  to  specify  the  uyatem  output. 

(b)  Associate  these  variables  t  j,  . . . ,  t^  with  the  time  variable  t  by  meane  of  the 
inspection  procedure  in  the  transform  domain.  The  result  of  this  procedure  is  the  trans¬ 
form  of  the  system  output. 

(0)  Then,  it  it  is  desired,  this  first -order  transform  can  be  Inverled  by  the  ordinary 
linear  system  analysis  methods  to  give  f  j(t},  f2(t),  and  so  on,  where  the  output  is 

fit)  •  f,(t)  +  f,(t)  +  . . .  +  f„(t)  +  , . . 

Otherwise,  the  output  signal  oan  be  interpreted  in  the  freqn»  ncy  domain,  as  la  often  done 
in  linear  system  analysis. 

Nonfactorlsable  higher -order  transforms  -  for  example,  situations  in  which  delay  is 
involved  -  oan  often  be  handled  by  solving  the  aseooiation  formula  (Cq.  115)  in  the  man¬ 
ner  given  by  Bqs.  121-125,  that  is,  by  working  partly  In  the  time  domain  and  partly  in 
the  frequency  domain. 

As  an  example,  consider  the  transform 

—t—  —I-—  (133) 

(Sj+e)"  (Sj+P)"' 


whtre  s^  and  $2  are  io  be  aeeoclated. 


This  is  (he  multiple -pole  situation  whi'::h  we  have 
ignored  previously  (Gq.  120),  Equation  133  ia  easily  Inverted  and  has  the  tratinform 


(n-l)l 


t"-» 

‘1  0 


(m-l)l 


t”-*  e 


Associating  tj  and  t2  yields 

A _ B  jn+m*2  ^-(a+p)t 

(n-l)i  (m-l)t 


and  this  has  a  tranaforni 


(n+in-2,'l 

AB - 

(n-i)l  (m-l)l 


1 


(134) 


which  is  the  result  of  associating  a^  and  S2  in  Gq.  133, 

Before  giving  some  examples  of  the  application  of  the  material  already  proaentod. 
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we  ahbll  round  out  the  diacueeicn  oi'  eystom  transforms  by  considering  some  other  pi  op  • 
ertiea  of  these  higher-order  transforms. 


3.3  STEADY -STATE  KESPONSE 


In  linear  nyslem  theory  with  fj  ■  and  x(t)  a  Ke  {Xe^‘^,  where  X  is  a  complex 

conetant,  it  is  well  known  that  In  the  steady  state,  the  output  f  j(t)  is  given  by 


fj(t)  a  Rc|xH,(ju)el"‘| 


where  H^(jw)  la  the  system  transform  H|(a)  evaluated  at  s  a  jw, 

A  similar  result  is  found  for  the  mgher-order  system  transforms  H^|(sj . s^). 

To  develop  the  steady -state  output  of  a  second -order  system  with  a  sinuioldnl  input,  oon 
aider  the  second -order  operation  on  an  input  pair! 

g2aH2(xy)  (13S) 

The  complex  functions  are 
Ju,t 

x(t)  a  xe  * 
and 

where  X  and  Y  are  complex  constants,  Ths  steady-state  value  of  g2(^)  tt^ven  by 

jUa  t  JW  t 

gjd)  aXlCHjdwj.lwj)  s  ‘  e  *  (136) 

whore  HjOuj,  JU2)  is  H2(S|,a2)  evaluated  at  a^  •  j»i)  and  B2  ■  jw2.  We  see  that  the  trans 
form  H2(sp  Sj)  has  a  steady -state  interpretation  ver;  lUuiilar  to  the  linear  transform 
Hj(a),  The  operation  of  Bq.  1  3  does  nut  exist  alone.  In  order  to  examine  thr  real 
aituatlon,  consider  the  actual  second-order  system,  with  f^  ■  tijix].  Let  x  ■  y  +  t,  with 

y(t)  -  f  eJ“' 


s(t).fe-i“< 

Here,  X  is  the  conjugate  of  the  complex  number  X,  Then 
x(t)  -  Re  {Xel*^ 

The  problem  now  is  to  find  the  steady -state  value  of  f2(t).  We  have 
ti  -  Hady+i)*) « H2(y*)  +  ZH2(yB)  ♦ 
and,  by  use  of  En.  136, 
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f{t)  » -l-Ke  1m)  VXripOu,  -jMlj. 

Hence,  the  steady -state  response  of  a  quadratic  system  is  uoniposed  of  a  dc  term  and 
a  double  frequency  term.  This  is  similar  to  the  effect  of  a  no-memc  .y  squaring  opera¬ 
tion. 

In  »  similar  manner,  the  steady -state  response  of  higher -order  systems  can  be 
formed.  For  the  third -order  case, 

f(t)  »^Ro  |x^H3(jM,jM,lM)eJ-’'**+JX*XH3(jM,.1w,  -jM>eJ“*|  (137) 

It  should  be  noted  that  the  solution  of  these  equations  depends  upon  being 

symmstrio.  If  the  operation  of  taking  the  real  part  la  omitted,  then  the  quantities 
X^HjOu,  ]u,  Jw],  and  so  on,  can  be  regarded  as  complex  amplitudes  of  the  corresponding 
sinusoids.  Just  as  in  linear  system  analysis. 

Not  only  do  these  results  furnish  an  interpretation  of  the  higher -order  transforms; 
they  also  show  that  the  steady -state  response  of  a  system  can  be  easily  obtained,  once 
the  system  transforms  are  known.  To  give  an  example,  oonMider  the  nonlinear  ampli¬ 
fier  of  Pig.  13,  Wo  shall  use  the  system  transforms  for  L3(s)  and  Ljia^.Sji  Sj)  devel¬ 
oped  In  section  2. 9. 

I-et 


Ai(s) 


and 


- ^ 

(s+s)*  +  M 


r 

0 


a,(s) 


.Al. 


Then 


L,(s) 


n jABs“ 


(s+o)^+M^  (•+P)^+<*>p 


and 


n^A 


Bs 


_ 


Br., 


Bs, 


[(sj+S2+Sj+«)*+«^]  [(•2+P)‘*+<-o]  [('y+PlX] 


If  we  apply  the  methods  that  have  been  given  for  obtaining  the  steady-state  sinusoidal 
response  (in  particular,  Eq.  137),  at  frequency  w,  we  have  the  following  complex 
quantities! 

(a)  Linear  gain. 


n,ABX(lw)* 


(138) 
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Proof*  of  Eqa,  141  and  14Z  are  given  in  Appendix  A,  3,  The  usual  Lnear  theory  oon- 
■trainte  hold;  all  llmlta,  In  both  the  time  and  froquenoy  domains,  must  exist. 

These  results  oan  be  used,  }ust  as  in  linear  system  analysis,  to  obtain  the  initial 
and  final  values  of  system  output  values,  slopes,  and  so  forth,  rapidly 

3.5  EXAMPLE  2. 

This  example  is  concerned  with  the  feedback  servo  jystrm  Pig.  15.  is  the 
i.uscade  combination  of  an  armature -controlled  dc  n...,ui  and  a  gain  iactor,  and 
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Kjfs)  =  A/(s+a).  The  output  f  is  the  motor  velocity,  and  N  is  a  compensation  device, 
(See  rig.  18.)  The  objecti-'e  of  thia  design  is  to  reduce  the  step  reaponse  time  of  me 
ayatem. 

first,  consider  the  linear  unoompenaated  ayatem  with  N  =  I.  T'te  step  response  of 
this  ayatem  la 

f(t)  a  X(l-«“^b  t>0 

and  A  »  a.  The  rise  time  of  the  ayatem  can 
but  there  la  an  acceleration  conatralnt  that 
llmlis  the  alee  of  A,  Thla  limit  on  A  ia 
determined  by  X^,  the  maximum  input 
amplitude  with  which  the  ayatem  is  to  be 
uaed,  and  by  M,  the  maximum  allowable 
aooeleratlon.  In  fact,  the  maximum  gain 
for  thia  linear  ayatem  Aj  la  given  by 

In  thlo  problem,  we  ahall  ahow  that  a 
■Imple  nonllntar  no  •memory  oompenaating 
devloa,  ■  1  +  Nj.  can  be  uaed  to  decrease 
the  response  time  and  still  meet  the  accel¬ 
eration  cunatralnt,  Only  the  firat  two  terms  of  the  output  are  significant  In  this  problem, 
and  hence  f(t)  ■  fj(t)  f  fj(t).  The  nonlinear  uyatem  in  thia  problem  la  the  same  as  that 
of  Pig,  IS,  and  the  first  two  system  transforms  have  been  given  in  Eqs.  105  and  106. 

If  the  Input  !:lt) '  '  u  transform  X/s,  then  the  output  transforms  are 

(143) 

■  (s+A) 


where  X  is  the  amplitude  of  the  input  step, 
be  reduced  by  Inci'eaelng  the  gain  factor  A, 


Pig,  la,  Example  2.  Charnoterlsatlon 
of  N. 


and 


n.AX' 


*  (Sj+S2+Sj+A)(Sj+A)(Sj,+A)(Sj+A) 


(144) 


By  using  the  inspection  technique,  we  obtain 


Fj(e) 


njAX^ 

(s-t-A)(st-3A) 


(145) 


and  thus 

f(t)  •  x|l  -  (146) 

Also,  we  hsve 
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(147) 


r(t) « AX 


njX' 


•jc”' 


■A4  4.  _3  _  v* 


-3At 


wnere  f'(t)  represents  the  acceleration.  It  is  possible  to  invuBtigi'^e  various  choices  ol 
A  and  n^  to  obtain  a  rapid  response  and  still  have  =  M.  A  ^ood  ctioloo  is 


(148) 


in  which  case  the  gain  can  be  taken  as 

A„  -T 


tn 


(149) 


and  the  acceleration  constraint  Is  satisfied  for  the  maximum  input  amplitude,  X^,  The 
0  to  90  per  cent  rise  time,  t^,  for  maximum  input  signal  is 


t 


a 

r 


(150) 


and  for  the  uncompensated  linear  case,  It  Is 


t 


r 


2. 


Therefore,  the  rise  time  can  be  dacreased  20  per  cent  by  the  use  of  simple  nonlinear 
compensation.  For  small  signals,  the  rise  time  has  been  decreased  25  per  cent, 


Fig,  19,  System  response.  (All  outputs  are  normalised  to  1.) 

Large  •  signal  input!  o,  compensated  nonlinear  system  ; 

uncompensated  linear  system.  Small-signal  input: 
X,  cumperinated  nonlinear  system;  A,  unoompeni'  .  ed 
linear  system. 


Figure  19  shows  the  transient  responses  for  mspcinr.ii'''  input  stops  and  very  small 
input  steps  for  thr  linear  uncompensated  and  the  nonlinea:  cunipensated  a^  stems  In 
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bo<li  r'jrves,  the  output  is  eorronlized  t*,  1.  Figure  18  gives  the  input -output  charncter- 
iatic  of  the  nonlinear  device.  It  U  specified  only  for  an  input  leas  than  Outside 

this  region,  any  saturation  oharacteriNtlc  suffices. 

It  ia  appropriate  i-  etnphasl/,e  the 


.'.rnportance  of  signal  amplitude  in  the 
analysis  and  synthesis  of  nonlinear  sys  - 
tens.  In  the  analysis  of  linear  systems, 
the  input -signal  amplitude  <s  rather  inci¬ 
dental.  This  is  not  the  case  with  nonlin¬ 
ear  systems  because  the  nature  of  the 
aystem  response  is  greatly  dependent 
upon  irput  amplitude.  Tlierefore  in  a 


III 

Fig.  20.  Example  3.  (a)  Lowpaas  am¬ 

plifier  with  output  distortion, 
(b)  Amplifier  A  with  feedback. 


nonlinear  eystem  problem  the  range  of 
input  amplitude  ie  a  very  important 
parameter.  A  knowledge  of  thie  range  ia 
esaential  in  using  the  functional  repre- 


eentation  fur  system  analysis  because 
this  will  determine  how  many  terms  of  the  output  must  be  retained. 

The  uie  of  nonlinear  compenaaiion  in  aervo  systems  is  a  problem  of  oonslderablo 
interest.  This  particular  example  has  been  given  not  only  to  illustrate  the  use  of  the 
funotlonal  rapreeentation  for  nonlinear  feedback  systems,  but  also  to  Indicate  the  poa- 
■ible  uee  of  the  representation  in  the  study  of  the  general  problem  of  oontlnuoue  nonlinear 

QOinpeftu , 


3.6  EXAMPLE  3. 

The  syeteme  of  Fig.  20  arei  A,  an  amplifier  with  output  distortion,  and  R,  the  same 
amplifier  with  some  weak  I'  'dbaok  f.ir  reducing  dletortlon.  In  this  situation,  the  cins- 
aioal  siandy -state  methods  do  not  sufflos. 

Let  have  a  tranaform,  H/s  +  a,  and  ^  ■  I  t-  Nj  +  Nj.  The  transforms  of  nyetems 
A  and  B  can  both  be  computed  by  the  methods  previously  explained  and  illustrated.  If 
the  input  is  x(t)  ■  Re  {Xe^*^},  The  transforms  can  be  used  io  give  the  dletortlon  ratios 
for  the  ayatems.  (Trantforma  and  details  are  given  in  Appendix  B.  1.)  For  low  fre¬ 
quencies,  these  ratios  for  system  A  are: 

First -harmonic  distortion  •-l-njB^X*  +-|-njB*X^  (151) 

Third -harmonic  distortion  ■  jHjB^X^  +  njB^X^  (152) 

Fifth -harmonic  distortion  ■  n^B^X*  (153) 

where  X  is  the  inpi4t  amplitude,  and  B  ■  tlX/a  is  the  dnear  low-frequency  gain.  Aseume 
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that  ^  is  approximate f  ■  *nd  OjU^X^  is  approximately  ^  ,  at  the  maximum 

value  of  the  input  amplitude,  X,  Then  the  ulstortion  ratios  for  feedback  system  B  are 
as  ^iven  below.  (See  also  App/'ndlx  B,  1.)  O  is  the  ratio 


H'  -  H 
“H 


(154) 


where  the  gain  factor  H  has  been  increaaed  tu  H'  to  keep  the  linear  gain  of  r.-.>idback 
system  B  equal  to  that  of  system  A.  These  ratios  arc: 


J  2  7 

First  “harmonic  distortion  a-l-njB  X 
Third -harmonic  distortion  ••yn^B^X* 
Fifth -harmonic  distortion  •  j^OjB^X^ 


4n5BV-4®-n*BVG 

(155) 

.^njB^X^-lln^BVG 

(156) 

-  nJ'B^X^G 

(157) 

We  see  that  feedback  can  be  used  to  deorease  the  amount  of  distortion  even  with  the  lin- 

2 

ear  gain  kept  the  lame.  It  is  interesting  to  note  that  if  n^  ■  3njG,  then  the  diatortion 
from  the  fifth -order  nonlinearitiea  will  be  completely  removed  by  the  feedback. 

This  example  could  be  extended  to  higher  dietortlon  and  stronger  feedback  by  devel¬ 
oping  more  of  the  terme  in  the  expansion  of  the  feedback  system. 

3,7  EXAMPLE  4. 


The  system  nf  r  ^la  is  an  example  of  an  FM  detector  of  the  phase-looked>loop 
type.  The  input  is 


f») 


Fig.  2i,  Example  4.  (a)  Pheee -looked  loop,  (pi  Equivalent  aysiem, 


(15«) 


x(t)  =  X  cos  I  u  t  +  r  8{t)  riT^ 
\  •'-«  / 


where  ia  the  frequency  of  the  ayetem's  voltage -oontrolleil  osc/Uator.  X  is  the  signal 
amplitude,  and  8(t)  is  the  modulating  algnal.  The  equation  for  this  .nultiplitativc 
feedback  aystem  is 


r(t)  =>  -XKLj 


^u^t  +  J  b(t)  dr^  sin  ^u^^t  +  j  rlr)  dt^ 


(159) 


where  Lj  la  the  idea'  lowpmas  filter. 
Expanding  Eq,  159,  we  obtain 


r(t)  a  -XKL, 


tin  +  J*  ^r(T)+a(T)}  di 


aln^y  {r(T)-i{T)}dT  j 


(160) 


Since  Lj  ia  lowpaaa,  the  term  with  frequency  centered  at  2u^  can  be  neglected,  and 
r  ■  A  aln  ‘{j{^[a-r]},  is  an  ideal  Integrator  and  A  ia  a  gain  conatant,  where  A  a  XK, 
A  diagram  of  thia  equivalent  ayatem  ia  ahown  in  Fig,  21b,  In  which 


H[yJ-Aalny  (161) 

Solving  fr  ttrat  three  terma  of  aystem  Li  we  obtain 

(162) 


'IZ3  1  \  1 

4'‘i'*2'*3'  "  3  rpTC  a^O  iJTTT 


^(•l . *5) 


A(a^+..,»ag)  ^  ^ 

•l"---'  •'•5  +  *  (-i+ag+A) 


(It:) 


(164) 


First,  the  syetem  atep  reaponae  will  be  computed.  If  the  input  e(t)  is  a  atop  ruaponae 
Su(t),  then  a  good  approximation  to  the  output  r(t)  for  sVa*  <  0,  5  ia  (jlven  by 

r(t)  «  rj(t)  +  r3(t)  +  r^{t) 

Aarooiated  with  r^,  r^,  and  r^  are  the  multiple -order  tranaforma: 
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H,(s)  L,(s)^ 

R(3)(8i,  82,63)  a  83.83)  jq  ^  ^ 

. "5)  "  Lg(8j . ^ 

Converting  these  to  the  first-order  transforms  Kj(h),  R3(8),  and  and  inverting 
(see  Appendix  O,  2  for  details)  gives) 


For  stnall  s/A,  the  system  Is  linear  with  a  reaponae,  r(t)  ■  S(l-a~^h,  and  It  departs 
algn*f'cn’'tly  from  thia  linear  operation  as  S  /A  approaches  0, 5.  It  should  also  be 
noted  that  If  r>  '>  A,  ,uen  the  system  beoomen  unstable  because  the  form  of  U  (see  Eq,  Ibl) 
reatrlrts  the  output  r  to  be  less  than  A,  and  static  balance  is  no  longer  poaeible. 

The  system  steady -state  distortion  with  sinusoidal  input  oan  bo  readily  obtained  by 
the  appropriate  substitution  of  Jw  in  the  system  liT, 'informs  (Eqs.  162,  16),  and  164). 

3,8  SUMMARY 

The  basic  material  for  the  analysis  of  VrOntinuous  nonlinear  systems  with  determin¬ 
istic  inputs  has  now  been  presented.  An  algebra  of  systems  has  been  'tnrd  to  describe 
a  system  in  terms  of  its  component  subsystems.  From  this  description  the  system 
transformo  oan  be  found.  Those  transforms  oan  then  be  used  to  determine  the  system's 
response  to  various  inputs. 
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IV.  REMARK  ON  APPLICAt;(jns  OK  THE  Al.GEBHA  OF  SYSTEMS 
AND  SYSTEM  TRANSFORMS 

We  shall  bo  concerned  here  with  several  topics  that  are  extensions  of  the  rriateriaJ 
presented  in  Sections  I -III,  The  first  ropir  conret  'j'l  the  use  of  the  algebra  of  systetns 
for  block-diagram  manipulations. 

4.  I  BLOCK-DIAGRAM  MANIPUL-iTIONS 

An  example  will  be  given  to  illustrate  how  this  algebra  con  be  used  to  perform  block- 
diagram  manipulations.  It  will  be  shown  how  >uoh  manipulations  can  be  performed  alge¬ 
braically,  rather  than  through  a  sequence  of  diagrams . 


Ill 


Fig,  22.  Block -dir  ^ram  manipulation:  (a)  feedback  system;  (b)  first 
equivalent  system;  (o)  second  equivalent  system. 

Consider  the  feedback  system  of  Fig.  22a,  In  which  !i  ■  -)■  My.  Ily  is  the  linear 

part  of  the  system  H,  and  it  the  ..onlinear  part.  The  object  of  this  example  Is  to 
show  how  the  linear  part  of  a  feedback  system  can  be  isolated.  We  have  LaI,+  H4<L> 
_1  +  (Hj+Hy)  *  Li  end  then  +  Hy  *  L'  or,  if  we  take  U,  •  1^  over  to  the  left- 

hand  aide,  we  have 

ll-gj)  *  L  •!+ Hy  *L  (165) 

Then 

(l-e,)''  *  (l-di)  •  t-  "  *  (1+H7*U)  (166) 


or 


48 


(lo7) 


Equation  167  is  the  Hystem  equation  for  the  syatetn  of  Fig.  22b,  with  the  linear  part  of 
the  system  concentrated  in  the  forward  loop.  Note  that  the  lineor  part  '^f  t  is  given  as 

•'  (l-Hjr* 

Now,  if  K  •  *  k.  fhcn  L  -  Lj  *  and  from  Eq.  165, 

K  ■!+  (Hf*Lj)  *K  (168) 

Thus,  another  equivalent  configuration  is  obtained  as  shown  in  Fig,  22c.  A  third  equiv¬ 
alent  configuration  could  also  he  obtained  with  Lj  in  itont  of  the  nonli.tcar  feedback 
system. 

There  are  several  reasons  why  such  changes  in  a  feedback  system  may  be  desired. 
For  example,  it  might  oe  more  desirable  to  construct  the  system  in  one  configuration 
than  in  another.  Or.  sonne  particular  configuration  could  be  the  basis  for  an  alternative 
system  expansion.  For  example,  Zames  (10)  has  developed  the  concept  of  expanding  a 
feedback  system  in  a  serlee  about  the  linear  part. 


4.2  COMP'.EX  TRANSLATION 


The  complex  translation  theorem  of  the  theory  of  linear  analyeis  (9)  can  be  stated 
os  foiljWk 

If  f(t)  hac  u  irausform  F(s),  then  e‘'‘^^'(i)  has  a  transform  r(s't-a). 

Her 4,  a  is  a  complex  number.  A  similar  theorem  holds  for  higher-order  transforms: 

If  f„(l|i<  •  •  >t^)  hu  *n  n-dlinensional  transfoi  m  •  •  >b„)i  then  exp(>a|t|- . . . 

f(tj, . . . ,  t^)  has  a  transform  •  •  •  >  ' 

The  Sj,  82,  . .  a^  are  comp  >x  numbers,  and  the  proof  is  essentially  thn  same  as  the 
preoi  for  the  linear  cMe. 

This  translation  c«ui  be  useful  in  finding  th'?  envelope  response  of  u  system.  For  a 
linear  system  H^,  with  transform  H|(s),  let  the  input  be  the  real  part  :,i' x(t),  where 
x(t)  a  e(t)  exp(jujt},  and  e(t)  is  real.  If  the  complex  output,  f(t),  ia  in  the  form 


f(t)  -  o(t)  e 


JUjt 


(169) 


where  o(t)  is  Ihe  complex  envelope,  then 


0(e)  a  Hj(B+jUj)  E(8) 


(170) 


as  can  be  shown  by  the  translation  theorem.  Then  o(t)  is  the  envelope  of  the  output 
sinusoid. 

To  Illustrate  the  use  of  the  translation  theorem  fur  obtaining  the  envelope  of  the 
output  from  a  higher-order  system,  consider  the  third-'  Jr  ■  system  Hj,  with  the  input 
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z(t)  .  Ke{x't)cj“‘^'''} 
where  x(t)  is  real.  By  expa;.ilrig 


us  we  ci>>i  (or  the  steady -state  situation,  and  applying  the  translation  theorem,  it  can  be 
shown  that  the  complex  envelope  of  the  third -harmonic  output  has  a  third -order  trans¬ 
form: 

•jX(sj)  XCsj)  X(S3)  Hjtsj+ju.  Bj+ju,  s^+Jw)  (171) 

when  X(b)  is  the  transform  of  x(t).  The  third -oroer  transform  of  the  enevlope  of  the 
first  -order  harmonic  is 

ix(aj)  Xlsj)  X{Sj)  Hj(bj+J«.B2+Jw,Sj-1w)  (HZ) 

and  the  associated  first-order  transforms  can  .hen  bo  found  by  the  methods  of  Section  111. 
This  procedure  for  finding  envelope  responses  generalises,  in  a  straightforward  manner, 
to  systems  of  any  order. 

As  an  example  of  the  calculation  of  envelope  I  '^sponses  of  nonlinear  systems,  oon- 
eider  the  feed-through  example  of  section  2,6.  For  this  system,  Lj(s)  and  L3(a|,S2,Sj) 
were  deve’upsd  in  section  3.3. 

Assume  that  e  is  sufficiently  small  that  the  third -harmonic  output  from  the  system 
is  neitligible,  and  let  the  input  x(t)  be 

jr(t)  *  uus  Wgt  t  >  0 

■  O  1  <  0 

Then  the  output  can  be  shown  to  be 

((t)  ■  (Oj(t)+Oj(t))  cos  fcfjjt  t  »  0 


The  transform  of  aj(t)  la  0|(s),  and  a  third-order  trsnsform,  OjCsj,  Sj,  Sj),  and  a  first- 
order  transform,  03(0),  are  associated  with  03!t).  Thus 


0,<s) 


L,(s+Ju)-^e 


n|ABX 

(a't-a)(st’P) 


03(01,  32- Ij)  ■  L,{s,+Ks2+J«.S3-J«)  i"  ^ 


3  UjAB^x’ 

*  (0j+S2+S3+o)(Bj+P)(B2+P)(Sjt-(i) 


so 


1. «  m, .  M  p  „„ 

rl  “”"  “'f ’•-;  ='  “■'  “' '"'  "■«»"■*.  Of  soood  Ul,  0,1.) ,.  ob..ted 

from  0^^j(aj,  Oj,  SjJ,  and  ■> 

,  4  n.KH^X* 

Oj(8;  - 

’  {8+a)(a+3p) 

Inverting  0,(e)  and  Oj(»)  yield* 

^  n.HKX  . 

((*■«) 


for  t  >  0 


and 


n,KH^X^ 


ri«rkn  a  * 

j(t)  .-I — _  (r«t„,-3pt, 


(jp-e 


for  t  >  0 


where  (oj(t)+Oj(t))  li  the  envelope  of  the  output  elnueold. 

4.3  A  FINAL. VAwUE  THEOREM 

A  variation  of  the  flnel-value  theorem  <aee  eeo,  3. 4)  will  now  be  given, 
. *n>  •  traneform  Y(a, . then 


. ’o' . 

It  ii  alio  true  that 

. . n)Vj 


‘r“ 


T" 


Zl  foTJZr  A-  condi - 

validity  ere  aim  Jar  to  thoee  for  the  final -value  theorem  of  iineur  theory  Thi* 
m«r.o,  .m  t.  «pu.d  ,.o„„  V,  d«,  ,h.„  „  ... «„ .. 


■») 


a^'b 


(*,+e2+p)(aj+e)(*2+a) 


J(.)  M  Inp..  .h«  ,1.,.,.  n.„  ,h.  ou,p.t  i.  ty 


(173) 


Since  the  system  has  reached  steady  state  before  y(t)  io  put  in,  £q.  173  shows  that  the 
system,  as  far  as  the  input  y(t)  Is  concerned,  is  of  the  form 

*1  ’  *  s  Jy>  +  So 

where  is  a  tero-order  system  —  that  is,  a  constant  -  and  H2  = 

H,(s..s,)  - - - 

‘  ‘  *  (sj+e2+p)(e|+a)(s2+B) 

Now,  2L2(ys)  ■  H|(y)>  and  by  applying  the  limit  theorem,  we  find  that 
H.(s)  .  Urn  2L,(s,p)£ 

^  p-*0  *  ^ 

,  2A^B  I _ !_ 

*  (s+P)  (s+a) 


The  final-value  theorem  also  gives  h^,  the  oonstant  associated  with  the  system  H^,  and 


h„.  Urn  L-Ui.e,) 
“  Sj-O  2  1  * 


This  prnh*  ' .  iiitroduoes  two  oonnspts:  (a)  the  idea  of  describing  a  system  about  a 
do  input,  and  (b)  the  use  of  this  modification  of  the  fir  .'.-value  theorem  to  find  the  trans¬ 
forms  of  the  new  system.  In  general,  a  system  of  any  order  oan  be  considered  in  this 
fashion. 


4.4  DELAY  'iHEOREM 

The  delay  theorem  states  that  If  the  eyetem  T  is  a  pure  delay  (or  advance),  with 
y(t-T)  •  T[y(t)],  then,  for  any  nonlinear  syetrm  H,  T  •  H  ■  H  *  T, 

Thie  follows  from  the  phyeloal  reason  that  It  docs  not  matter  if  a  time  delay  precedes 
or  follows  a  syatem  operation  of  any  kind.  The  particular  case 

T  •  •  T 

—  — n  — n  — 

oan  be  derived  from  traneform  theory  because 
-■.T-...-s„T 

’  "  «n<»I . -n> 

is  the  transform  of  T  «  H  .  and 
—  — n 
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(175) 


is  the  transform  of  T.  Obviously,  Eqs,  174  and  175  are  equal. 
4.5  DIPF.-HENTIATION  THEOREM 


If  D  is  a  differentiating  wystem  with 

Dly(t)l  •  ^  .v(t) 

then 


D  *  ■  nH„  o  (D.l")  (176) 

where  1  is  the  Identity  system. 

We  shall  prove  this  by  using  transform  theory.  The  transform  of  p  is  s,  and  the 
transform  of  1  is  1,  and  hence  from  Eqs.  90  and  95,  the  transform  of  nQ^  o  (Q.^")  is 

nH„(s, . sjsj  (177) 

Applying  the  symmetrisation  procedure  of  section  i,  9  gives  Eq,  177  in  symmetrical 
fcrm: 

V*1 . 'n^'l+'^+V 

The  transfur.,)  ui'  2  * 

■  ll 

(»!+.., +Sj,)  H|,(s Sjj) 


by  appUoatlon  of  Eq,  92.  Since 

»n<»  1 . ‘nX*  !+•  ^  •  +•„)  H„(s  I . s„) 


it  follows  that  Eq,  176  is  true. 


4.6  LIMIT  CYCLES 

A  feedback  system  (see  Fig,  23)  for  which  the  total  system  operation  around  the 
loop  is  L,  with  L  ■  9  force-free  (no  driving  input)  balance,  in  the  steady  state, 

when 

L[xl  >  X  (178) 

in  the  steady  state.  The  particular  ftinotions  x(t)  thut  satisfy  Eq.  178  are  called  "limit 
cycles,"  It  is  seen  that  x(t}  >  0  satisfies  Eq.  178  (p  is  assumed  to  have  no  sero  .urdor 
part).  Therefore  all  systems  have  at  least  one  limit  cyc.le.  If  Eq.  178  has  one  or  mure 
nunr.ero  solutions,  then  ihe  system  output,  under  approp  rt,-  initial  excitrtion  conditions. 
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will  tend  toward  some  one  of  these  eolutions  in  the 
steady  state,  A  aystem  is,  then,  iinetable  if  notiitet'o 
Ur- It  cycles  extut. 

Some  of  tho  cycloa  themselv:;s  tnay  be  unetabh;  - 
that  la,  the  output  will  tend  away  from  these  unstable 
limit  cycles,  r  ather  than  toward  them.  If  x(t)  ■»  0  is 
an  unstable  limit  oyole,  then  the  system  is  small - 
signal  unstable.  That  is,  any  small  signal  will  cause  a  system  excitation  that  will  not 
die  down. 

Returning  to  the  balance  equation  (Eq.  178),  we  let  L  ^  Hj  '*'  ]$•  where  tij  is  a  linear 
lowpaas  system,  and  is  a  nonlinear  system.  In  this  case,  the  balance  equation  in  the 
steady  state  can  be  solved  by  assuming  that 

x(t)  «  X  cos  wt  (179) 

Note  that  it  does  not  matter  if  oasoado  components  that  make  up  form  a  oyolic  permuta> 
tlon,  For  example,  A  *  B  ti  c,  S  *  £  *  "hd  £  *  _A  *  B  are  equivalent  forms  of  L,  as 
far  as  £q.  178  la  oonoerned.  All  wn  are  doing  la  writing  the  balance  condition  at  a 
different  point  in  the  loop.  The  particular  form  uaed  la  determined  by  finding  out  which 
form  glvea  the  eaalcat  anawer. 

Following  the  eolation  of  the  balance  equation,  we  have 

K[x(t)]  ■  K(X,  u)  cos  wt  +  higher  harmonica 

where  K(X,w)  la  a  function  of  the  amplitude  X  and  frequency  u.  Because  of  the  lowpasa 
oh-ro  ■♦er  of  H,,  the  solution 

Hj(Jo))  K(X,u)s  1 

for  X  and  w  is  a  closely  approxlmats  solution  of  the  balance  equation.  Thie  ii 
the  "describing  lunation  method"  (8),  and  the  value(s)  of  X  and  w,  eo  found,  give 
Eq  179  as  the  limit  oyolevs).  A  limit  cycle  is  stable  if  changing  the  amplitude  X  to 
X  +  AX  gives 

Hj(Ju)  K(X+AX,  w)  <  I  for  X  +  AX  ?  X 
and 

H ,  (Ju)  K(X+AX,  w)  >  I  for  X  +  AX  <  X 
Otherwise,  the  limit  cycle  Is  unstable. 

For  any  system  in  which  the  loop  operation  L  oan  be  deacrlbed  by  the  functione'. 
aerlea,  or  polynomial,  tho  traneforms  , , , ,  jw^)  can  be  used  to  solve  the  balance 

equation  (Eq,  178)  In  the  eteady  etate,  at  least  if  the  number  of  har  mica  Involved  is 
not  too  large.  It  can  be  assumed  that 

2x(t)  *  Xje*“*  +  Xje”^"*  +  +  .  . . 


Q 


Fig,  23,  Feedback  system. 
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and  cUt!  values  of  X21  etc.,  and  of  i:  that  satisfy  Eq.  178  can  be  found.  The  x4.)  so 
found  are  limit  cycles  and  their  stability  can  be  investigated,  as  in  the  previous  special 
case,  by  finding  the  effect  of  a  small  amplitude  change, 

4.7  MEA.SUREMENT  OF  NONLINEAR  SYSTEMS 

Our  final  topic  here  is  the  measurement  of  nonlinear  systems.  Two  techninues  will 
be  mentioned  -  time  domain  and  frequency ‘domain  measurements.  The  dieuussion  of 

the  measurement  topic  will  be  completed, 
in  Section  V,  by  describing  a  measure^ 
ment  procedure  based  on  a  white  Qausslan- 
noise  input.  The  discussion  here  shows 
only  that  measurements  are  theoretically 
possible.  Thus  far,  no  iiuch  measure - 
ments  have  been  made. 

Unlike  the  input -signal  amplitude  in 
(ai  linear  systems,  the  amplitude  of  the  input 

signal  of  a  nonlinear  system  is  of  great 
importance.  Both  the  analysis  and  meas¬ 
urement  of  a  nonlinear  system  are  depend  - 
ent  on  the  amplitude  range  of  the  Input 
signals  for  which  the  system  is  to  be  used. 
For  this  reason,  the  input  test  signals 
fahould  be  bounded  signals,  and,  further  - 
more,  the  amplitude  of  these  signals  need 

coefficient  mj(t].  For  the  reasons  mentioned,  we  shsl! 

adopt  the  step  function  for  the  input  test 
signal  for  time-domain  measurements.  Consider  a  nonlinear  system  h,  with  L  ■  Li 
Lg  ^  "  L[s] ,  The  output  f(t)  for  an  input  step  function,  x(t)  ■  Xu(t), 

is 

fW-xJ^*  ll(T)dT+...  yr, . y  dT,  ...  dT„  +  ... 


For  a  pcrticular  value  of  time,  t^. 


Equal 'on  180  is  a  Taylor  series  in  X.  r.ncl  the  output  f(tj)  is  dependent  upon  X,  t-a  lyiiown 
in  Fig.  24a.  If  f(tj)  ie  founu  experimentally  as  a  function  of  X,  then  It  Is  theoretically 
possible  to  isolate  the  coefficients  tn,^(tj)  In  the  Taylor's  series.  If  these  coetfictents 
are  obtained  at  a  set  of  tl.nes  tj.  ....  t^,  then  they  can  be  plott^.u.  as  is  shown  i.-i 
Fig.  24b  for  m|(t),  to  determine 

The  impulse  response  of  I^j,  can  be  shown  to  be  the  derivative  of  mj(t],  and  so 
l,(t) 

Therefore,  the  Impulse  response  l|(t)  can  be  theoretically  Heterrnlned. 

Now,  the  Impulse  response  of  can  be  found.  To  do  this,  we  take  as  input  x(t)  a 
y<t)  +  B(t),  where  y(t)  ■  Xu(t),  *(t)  »  Xu(t+T),  and  T  is  some  positive  number.  The  out¬ 
put,  then,  is 

f(t)  •  Xp,(t)  +  X^PjW  +  ...  +  X''p^(t)  +  ...  (mi) 

where 

Pn<^)  •  /J  •  •  •  /o*  ‘n<"l'  •  •  •  *  V  ‘‘"l  • '  •  “^n 

Again,  the  p^(t)  can  be  determined  by  the  use  of  Taylor's  lerloa,  as  the  m^^(t)  were. 
The  term  Xpj(t)  la  not  needed  and  can  be  ignored,  From  P2(t)  the  impulse  response 
Ijdjitj)  can  be  found  In  the  following  way. 

P2(t) « u!'"'  ;*) 

■  ij2{y*+2sy+**) 


^t+T  ^t+T 

"Jo  Jo 

/•< 

■  m2(t)  *  ^  *2^’'l‘  ’’2^  dTjdT2  +  mjU+T) 


l2(i'i.T2)dTjdT2 


But,  m2(t)  le  known,  and  so  the  term 


nt+T 

j  ‘2(Ti.T2)dT,dT2 


can  be  isolated.  Repeating  this  moaeurement  for  a  l  umber  of  values  of  T  will  pi  uducr 
the  two-variable  function  g2{t].t2).  Then  it  can  be  ah'  vn  that 
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and  now  12(1  j.tj)  nan  be  theoretically  '"terminod  from  Kjjli-tj)* 

in  a  similar  manner,  l^(tj,  tj)  can  be  found  by  using  an  Input  tfipirt  of  step  fum;  • 
tiona,  that  la 

*(t)  =  Xu(t)  +  Xu(t+Tj)  +  Xu(t+T2) 

Theoretically,  the  procedure  can  be  continued  to  find  the  l„(t,, , . . ,  t^^)  to  any  order  n 
that  is  deelrecl. 

The  frequency  -domain  meaaurementa  are  almllar  to  the  time-domain  meaaurements, 
in  their  use  of  Taylor's  nerlea  to  Isolate  the  various  terms.  We  have 

f(t) -lii(x(t)]  +  U2[*(‘)]+ +ii„{x(t)]+ •••  <1831 

where  Ijj  has  a  transform  has  a  transfornt  HjOw).  and  so  on.  Let  the  Input 

x(t)  be  a  elnusoid,  and  then 

x(t)  ■  X  Re  {eJ*^} 

where  X  la  a  real  number.  Direct  application  of  the  steady -state  methods  of  section  3.3 
gives  an  output  that  le  the  real  part  of 

tit)  -  XHj(J«)  eJ"*  +  ^X^HjIJw.  -jw) 

+  |x2h2(K1«)*^*"* 

+  -y  X^Hj(j«,  Jw,  -j«) 

+  ix*H3(j«.KH 

+  -I-  X*H  j(,lw.  Ju.  -Jw,  -Jw)  +  . . ,  (184) 

Steady -state  harmonic  measurements  can  be  taken  to  determine  the  coefficients  of 
e''”“*,  which  are 

Ix^H^Ow,  -Jw)  +  •|x‘‘h^{Jw.  Jw,  -Jw,  -Jw)  +  . . . 
for  n  ■  0,  and 

XHj(Ju)  +-|-X^Hj(ju.,  Jw,  -Jw)  +  . ,. 

for  n  "  1,  and  so  on.  With  measurements  for  various  frequencies  and  values  of  X, 
the  Taylor-saries  approach  can  be  used  to  isolate  Hj(Jw),  ll.fjw,  Jw),  HjtJu,  -Jw)  and  so 
forth.  In  a  manner  quite  similar  to  the  previous  use  of  multiple -step  Inputs,  input 
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sinusoids  of  the  form 


Ju.t  ju.t 
X  e  ‘  +  X  e 


•re  used  to  obtain  HjOw,  ju2).  In  general,  multiple  sinusoidal  inputs  can  be  used  to 
determine  the  . . . , 

Two  methods  have  been  deaoribed  for  the  determination  of  the  impulse  reaponsea  or 
transform!  that  characterise  a  nonlinear  system.  In  Section  V,  another  tne’‘  od,  based 
on  a  random  Input,  will  be  dleeuaaed. 

Note  that  the  measurement  of  Impulse  responses  snd  transformu  Is  considerably 
more  oomplicated  than  such  mesauremtntM  for  linear  systems.  This  Is  to  be  expected, 
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V.  UAUDOM  INPUTS 


5.1  INTRODUCTION 

In  Seotiona  I-IV  we  have  been  ooncei'ned  with  the  functional  representation  of  ron> 
tlnuous  nonlinear  systetns,  and  with  the  uae  of  this  representation  in  conjunction  with 
determiniatio  inputs.  We  shall  now  consider  random  inputs.  Output  averaceh  nnd  cor¬ 
relation  functions  will  be  computed  i.y  means  of  the  functional  representation.  Oaussisn 
Inputs  will  receive  the  principal  emphasis,  and  certain  optimum  operations  on  Gauaelan 
and  Oauaaisn -derived  aignalt  will  be  developed.  A  syatom-mensurement  technique  based 
on  a  white  noise  input  will  be  diecussed. 


5.2  OUTPUT  AVERAGES 

Let  us  consider  f  =  H[x].  where  H  ■  Hj  +  Hj,  +  . . .  +  +  . , ,  .  A  typical  term  is 

<„(t)  ■  Hn[*<0] 

•  h^(Tj,...,T^)x(t-Tj)  ...  i{{t-Tjj)dTj  ...  dr^  (185] 

and 

f(t)  •fl(t)+ ...  +  f^(t)  +  ...  (186) 

Now,  .ak'-'ir  nvertfres  on  both  tides  of  Bq.  186,  ws  have 
f(t)  -  f,'(t)  +  . . .  +  fjjt)  +  . . . 

and  the  object  it  to  find  f(t)  by  computing  the  (Here,  we  consider  all  random  sig> 

nala  to  be  ergodlc.  Therefore,  averapee  can  be  taken  as  time  svertgea  or  enstmbla 
averages.  The  average  of  a  signal  B(t)  will  be  denoted  e(t).)  This  f^(t)  is  given  by 

f f  ‘'n^'l*  x{t-Tj)...  x(t-Tjj)  dTj  . . .  dr^^  (187) 

Interchanging  ordera  of  integration  and  averaging  in  Eq.  18Y  gives 

"  f  "'f  •••  ‘*’^1  '*’'n 

If  the  correlation  function  x(t  j)  . . .  x(t||)  is  Known,  f^(t)  oan  be  found  by  performing  the 
integrations  of  Eq.  188. 

It  is  convenient  to  introduce  a  short  notation  thet  la  related  to  Ihe  operator  n'^tstion 
uaed  previously.  In  this  notation  Eq.  188  beoomea 
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and  tne  average  of  the  output  f  iu 


n 

The  subacripte  1,2,  ■ , . ,  n  refer  to  the  aubsorlptr.  of  Tj,  . . . ,  in  E:q.  188, 
Similarly,  for  the  caloulatiun  of  output  correlation  tunctioiia,  we  have 

f(t)  f(t+f)  -"{f^i+Tri+f^ft)*. .  >{fj{t+T)+.  .Tf^+T)+77.} 

-Z  Z'^C<^‘^) 


fjt)  f„(t+T).  J  ...J*  hjT, . T^)  X(l-T,)  ...  *{t-T^) 

dTj  ...  dT^  /•••/  V^l . 

...  x(t+T-T^)  dTj  ...  dT^  (190) 

After  rearrangement  and  interchange  of  the  order  of  averaging  and  integrating  Bq.  190 
beoomea 

f„(tr^!ti  *i  -/•“]*  . V'^+'^m+l . ^+'m+n) 

*(t-T,)  ...  x(t-T^^„)  d .  .  .  dT^^„  (191) 

The  "impulse  reepor.ie"  In  ‘hie  expr*aalon  ie  that  of  the  ayetem  •  (P*'!!^),  where  P 
is  an  ideal  prediotor  with  time  shift  T,  and  has  an  impulse  response  8(tt-T).  We  abbre> 
vlate  this  es  •  H^,  and  then  Eq.  109,  in  the  short  notation,  oeoomes 

-  (b^.hJ)(x,:.  .x^,7)  (192) 

As  in  the  previous  case,  the  output  autocorrelation  function  can  bo  computed  if  the 
higher -order  input  oorrelation  hinctlona  are  known. 

5.3  GAUSSIAN  INPUTS 


In  the  important  situation  in  which  the  input  signal  la  Gauoslanly  distributed,  the 
oaloulation  of  the  output  averages  is  not  too  difficult.  Emphasis  wil.  oe  pluued  on  aucii 
inputs,  First,  the  ap.icial  case  of  white  Gaussian  inputs  will  be  oonaldered  end  then 
this  will  be  generalised.  Wiener  (5)  has  rigorously  considered  Uts  white  Cause iar. -input 
oaae. 
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If  x(t)  is  white  Gaussian  w.,,i  a  power  density  of  I  watt  per  cynle,  then 


x(t)  a  0 
x(t|)  x(t2)  s 
x(tl)  xttg)  x(tj)  =  0 

xjtj)  xitjj  xdj)  x(t^)  =.  +  6(t3-tj)  +  5(Vtj)  SUj-tg) 

and  ao  on,  where  &(t)  ia  the  unit  impuiao  function.  !.i  tfenerai,  the  average  ia  zero  if  the 
number  of  x'a  ia  odd,  and  la  a  aum  of  producta  of  impulae  reaponaea  if  the  number  ia 
even.  In  general, 

x(tj)  ,,,  x(t^)  6(tj-tj)  (193) 

The  product  ia  over  aome  aet  of  pairs  of  numbera  taken  from  the  numbera  1,  2,  . . . ,  n, 
auch  as  (1,  3),  (2,  4),  (S,  7),  and  ao  forth.  The  aum  ia  over  all  auoh  aeta. 

In  the  -order  oaae,  there  are  N  -  (n-l)[n-3)  ...  1  terma  in  the  summation,  .nnd 
so  for  n  even 

^  ‘  /“  •/  ’2 . ■^n>  I  n  6(tj-Tj)  dt,  . . ,  dT„ 

*”/•■•/  V"l-"l'’2''2 . V2'V2^  ‘‘^“^2  '*V2 

where  h|^(t|,  •  •  •  •  t^)  ia  symmetrical.  (Note  that  bernuae  of  this  symmetry,  the  various 
terms  In  the  sum  of  Eq.  193  contribute 'dentlcally  in  Eq.  194,}  Hence,  f(t)  can  be  deiur- 
mlned  by  performing  the  integration  of  £q.  194  for  each  of  the  f|^(t)  in  the  sum 


A  typical  term  in  the  correlation  function  equation  (Eq.  192)  ia 


where  has  an  impulse  response 

“m^h . V  '’n<'r"‘mtl . 


and  this  impulse  responre  is  not  symmetrical.  Tiierefci  «-  it  it  necessary  to  take  into 
ai'nount  the  various  terms  of  Eq.  193.  For  example, 
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I+T^) 


{6(tj-t,)6(t^-Tj)+6(t^-Tj)6(t4-T2)+6(t^-Tj)6(t^-T2)}  rlTjdT^riT^clT , 

*  ‘lTjdT2  +  2jJ h2(T,,T2)h2{T+T,,T+-2)  dr^dx^ 

(198) 


In  a  Blmilar  manner,  we  obtain 


“ ffff  hi(Tj)hj(T+T2,T+T^,T+T^) 

{6(t2-Tj)6{t^-Tj)+6(tj-Ii)6(t^-T2)+6(t^-Tj)6(Tj-t,)}  dTjdT^dXjdT^ 

■  J^hj(T)hj(T+T,(r,ir)  drdir  (199) 


Generally,  when  we  are  faced  with  aik  uneymmetrloai  eltuailon  It  U  a  atraightforward 
matter  to  determine  the  varioua  terma  of  expreaaion  197,  The  general  term  that  arlaea 

la 

r. . .  f  •  •  • .  •  •  •  • 

W  • 

Xhn<T+»j,...,T+Tp,e^j^j,»^^.j,...,ifp,ep)dTj  ...  dipdej  ...  dcr^  (200) 

Here,  p  +  2q  ■  m,  and  p  'f  2r  >  2q  ■  n.  It  ahoulil  He  remembered  that  exprtdBlon  197 
equala  aero  If  m  +  n  la  odd.  Once  thi.  terms  f  )(« j  • . .  *’**"  determined, 

f{t)  f(t+T)  is  given  by  Eq.  192,  '  ' 

The  results  for  white  Oauaslan  inputs  can  be  used  to  obtain  output  averages  and  cor¬ 
relation  functions  for  non-white  Gausaian  inputs  into  a  system  fl.  In  the  non-white  case, 
the  Gaussian  signal  can  be  formed  from  a  white  Gaussian  signal  by  means  of  a  linear 
shaping  filter,  Kj.  This  is  illustrated  in  Fig.  25.  Then,  rather  than  work  with  a  non- 
white  Gaussian  input  to  a  system  H,  we  work  with  a  white  Gaussian  input  to  a  system 
U  e  |S|,  Aiso,  if  the  input  to  a  system  H  is  non-Gaussian,  but  formed  from  a  white 
Gaussian  signsi  by  a  known  nonlinear  operation  Ji  (which  can  be  expanded  in  the  func¬ 
tional  representation),  then  we  can  work  with  a  white  Gaussian  signal  to  a  system  H  *  K. 


SHirs 

a«uiiiAN 

i'9N«L 


LIMUM 

PlLTKft  S, 

NON.WHirS 

oaussiMi 

siesai. 


Fig.  2.5.  Illustrating  the  use  of  shaping  filter. 
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S.*!  UiE  OF  TRANSFORMS! 


Tht,  averages  given,  for  example,  by  Eqs.  194  and  198  could  he  found  by  performing 
the  indicated  Integrationa  of  the  usually  awkward  Impulse  responHes.  However,  this  ’ 
difflcultv  can  be  overcome  by  the  nee  of  transformo.  The  transforms  considered  here 
will  alw>.ys  be  Fourier  traneforms  (see  Appendix  A.  1)  and  s  «  jw. 

To  develop  the  use  of  transforms,  three  typical  situations  will  be  explaineu.  First 
consider  the  term  * 

iinixi.  •  •  V  /  V’l*  . V’-  d’l  .  • .  dT^/2  (201) 

from  Kq.  194.  The  transform  of  hjt, . t„)  Is  HJs, . sj,  and  hence  the  trans- 

form  of  h^(t,.  ij,  t-. ....  t^^)  can  be  obtained  by  Inspection  If  H  (a  _ c  )  is  fcctorlxable . 

r.«t  the  transform  of  h^^d j,  tj.  tj. . . . .  t^)  bo  " 

\-l**l'*3' 

Now.  the  first  integration  of  Eq.  201  can  be  performed.  Thic  Integratl-.n  Is 


J*h|j(Tj,  Tj,  Tj,  T^)  dXj 


and  R  can  be  obtained  from  K„_j(.,. ....  s„)  by  the  method  of  section  4. 4.  That  Is.  the 
tranitor...  - 

.\‘!ro*^n-lf‘l>*3 . n> 


Let  this  expression  equsi  L„  ,{s3 . s„).  which  is  the  trsnsform  of 

. V''"! 

The  operstlon  csn  be  reps.ted  on  . ,^)  to  perform  the  second  integration  of 

Eq.  201,  and  ao  on  until  It  has  been  evaluated. 

As  an  exsmple,  considei 

JJ>4(Ti,Ti.T2.T2)dTjdT2  (202) 

where  l^(tj,  (2,  tj,  t^)  has  a  tranaform 

- A _ L_  1  1  1 

Sj  t  82  +  Ij  +  +  0  8,  +  P  S2  +  p  Bj  +  p  8^  +T  (ZO3) 

The  first  assoc fstioii  gives 
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8,  +  Sj-K-U-  84-rT 


and  taking  the  limit  a  ^  0  givea 

A _  1  1  1 

bj  +  +  o  IS'  83  +  ^  ^ 


AflBociating  *he  other  two  varlab.  eB,  we  obtain 


-i-  A  1 
2|&  B  -t  R  a  +  2(3 


and 


Tj.Tj)  dTjdTj 


lim 

«-*0 


J _ » 

2|3  S  +  0  B  +  2P 


The  aeoond  aituation  to  be  studied  ia 


U04) 


(205) 


/.../ 


. 


Ab  we  have  done  before  with  tranaforma,  wc  introduce  T^,  into  thia  term 

and  conaider 


f.-.f  -V  '*"n 

Taking  the  higher -order  tranwform  of  thia  e»"reB.>>ion  yieida 
. . "n> 


The  actual  transform  of  Eq.  206  can  now  be  obtained  from  Eq.  207  by  associating 
Tp  . , , ,  with  T  by  meana  of  the  inspection  technique  if  the  trunaforuis  are  factor - 
izable. 

In  using  the  inspection  technique  it  should  be  noted  that  the  contribution  of  terms  of 
the  form 


^n+l^^l'  •  ■  •'■n‘*i''’*J^  Q(-Sj)  (258) 

ia  zero  when  T^  and  are  aseoolnted.  This  ib  bo  beuauae  the  T^  mid  Tj  in  the  inverse 
transform  of  Eq.  203  are  tn  disjoint  regions;  that  is,  Tj  >  n  and  Tj  <  0.  lirnce  there  is 
no  contribution  for  t  =  •  Tj. 

In  order  to  Illustrate  the  method,  consider  the  7Bc  in  which 
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H,(s,,8,)  H,(-s,,-s,)  » . . . . . . . 

(-Bj-Sp+P)(a,+B2  +  3)(-B  j+uX-B^-to)  (SjfoXa^+o) 


_  J_  _ f  1  ^  [  1  +  — ‘  - 

4^2  (-aj-s2+P)(ai+82+P)  “  «1  +  »/  \-B2  +  «  +  « 


\(-Sj  +  b)(-I 


Bj+b)  (sj+ol(B.4a) 


+ - - -  + - i - 

(8j4«)(-82^a)  (-Sj+tt)(i.2+“) 

AsBOcidtlng  the  varUbleB  by  inspection  yields 


Jit  1  -  /-J-.  +  -l-l 

*?■  (-B+P)(S+P)  1"“+““ 


and  the  terms  involving  [(a j+aK-Bj+s)]"^  and  [(-Bj+a)(82+a)] give  no  oontrlbi'tlon. 
Equation  210  is  then  the  tranaform  of  ’’z^  h2(T+Tj,  T+tg)  d-'jdTg,  where 

I  /.  .\i _ .t.  _  .  .  _  •*/_  ..4  •• 


^2^^r^2^  has  the  transform  M2(Bj,S2)> 

A  third  situation  that  arises  is 

/'“/  V  ‘‘m^^i*’' . v^'^r'i . VV'*"!  •  •  •  'l^n ‘*'^1  •  •  •  % 

where  m  +  n  l.s  won,  p  «  (m-ri)/2,  ami  «>  ^  n,  First,  conglder 
/•••  /  ''m^*l-”’'V'l''"l . V  V'“'l  '^“'p 

where  •  •  •  >  t^)  has  a  trv.isfvrm  •  ••  •  *^*''*®^  apolloatlon  of  the 

first  method  discussed  in  this  section,  the  transform  of  Eq.  211  can  be  obtained.  Once 
this  has  been  done,  the  situation  is  the  same  as  in  the  second  case  and  the  method 
Involved  there  can  be  used.  In  a  similar  manner,  the  general  form  of  Eq.  200  can  be 
handled. 

For  example,  consider 

J^hjirl  hjd'+T,  r,  ff)  drdo-  (21Z) 

where  hj(t  j,  t2,  t^}  has  a  transform 

K _ 1  1  _1 _  , 

8j  +  1,2  +  *3  +  “  S|  tT  Sj  +  P  *3  +  P  \2‘ii 

and  hj(t)  has  a  trhnBforin  H/is+o). 


6i> 


Consider 


y*hj(t,  IT,  ir)  dor 

Associating  Sj  and  Sj  in  Sq.  213  yields 

—  K  1 _  1 

"l  +  +  a  s"j  +  p  Sj  +  2p 


Let  Sj  -  0.  in  order  to  evaluate  the  integral  o/  Bq.  214.  and  w*  have 


-J£ _ L.,  1 

■l  +  «  »j  +  ?  If 


(2H) 


(215} 


(216) 


Which  is  the  transform  of  Eq,  214.  Squetlon  212  has  a  transform 


KH  1 


1 


(-S+fl)  (f.  Vff  )(s.!/J) 

Inverting  this  transform  gives 

2(s4A)(e-^)  •"“*}  for  t  >  0 


and 


2s(a-t|l) 


.«t 


for  t  <  0 


for  Bq.  Zi.>, 

r.:~*  “r  •• -'”- 

9.S  EXAMPLE  5. 

The  system  for  thle  exam|.le  is  shown  in  Fiu  zt  »  . 

the  average  square  of  the  aau«i«,  .ig„,i  y(t)  rK,  ei  ‘"  ‘f  measuring 

Osussian  x(t)  by  mesne  of  the  shapli  filter  A  with*/!  M  a 

s.  u .  zr 

over -all  system  operatiig  on  x(t)  is  t,  . 

fi]  '*  ??2  *  where  N,  is  a  no -memory 
square  r.  ano  Og  ■  1. 

!■  irst,  we  ehail  obtain  the  .  versge 
square  of  y(t).  This  is  the  average  of 
the  out,  It  of  the  system  H,  »  N-  *  A 

£  —2  j 


Fi<.  26.  Apparatus  for  meaourlng  avar- 
age  square  of  the  ejgnal  y(t). 


operating  on  x(t).  The  output  om  le  y^(t)>  Then 
y*(t)  ■  HjUjXg) 

«(T2-t,)dT,dT2 

■  J* KjCt,  t)  dT 

and  h2(tpt2)  hm  n  tranafurin. 


H2{«i.«2)  • 


(i|+o)(»2+«) 


2 

Aaaocivting  tj  and  t2  i:lvoi:  A  /(■4-2a),  from  Eq.  203,  and  so 


2  *2 


“  l‘”o  *4-fr 


Next,  we  ehall  obtain  the  average  output  from  the  ayatem  Lj*  where 


(aj+a^+PXej+eXBj+e) 


AeaonUttng  th'".  v«f'  iea  givee 


(B+P)(B+2a) 
from  Bq.  204,  Then 

W)-Um  - 

a-*0  (B40)(a42a)  *“  ^ 

and  f(t)  >  y  (t)  when  B  «  p.  We  aoe  that  the  apparatua  doea  meaaure  the  average  of  y  (t). 
However,  the  output  f(t)  ia  not  a  conatant,  but  a  randotn  variable. 

To  conclude  thin  example,  we  obtain  the  output  apeotrum  tf(w}.  The  output  autocor¬ 
relation  ia  given  by  application  of  Eq.  199: 

•f^T)  -  l2< V ’’a) 

T+T2)  dTjdTj  (218) 

where  l2(t],t,)  i«  the  impulie  reaponae  of  the  ayatoir  .  tie  firat  term  o:  Bq,  21B  can 
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be  shown  (see  Appendix  B  to  equal  ^  when  B  »  f).  Also,  from  iHq,  ?1V, 


2A^B^ 


(-8j-«2+P)(*i+*2'*'P)(‘*i+“H“Jj+a)(S|T>i)(a2+o) 

and  ai^plioation  of  the  inepeatlon  method  (see  Appendix  B.  3)  given 
1 


2A^B^ 


”7"" 

td  *f  0  u  *f  4a 


when  ju  ■  a.  Therefore,  the  epeotrum  is  given  by 


6(.)  -j- 


1 


«-  +  (S-  w‘  +  4o‘ 


(220) 


9.6  EXAMPLE  6, 


Thii  example  ia  oomuurned  with  the  feedback  ayatem  of  lootion  3.5.  The  problem  ie 
much  the  aame,  except  that  here  the  input  ia  a  random  aignal,  Oaueaianly  distributed. 
Our  object  is  to  use  the  nonlinear  compensating  device  to  decrease  the  servo  following 
error  and  still  meet  a  constraint  on  the  maximum  allowable  rms  acceleration. 

The  system  input  is  x(t),  the  output  is  f(t),  and  the  following  error  ia  e(t)  ■  x(t)  -  f(t). 
The  acceleration  of  the  motor  ia  a(t)  >  d/dt  f(t). 

First,  wo  i :  u  consider  the  linear,  uncompensated  system  with  N  ■  L  The  input 
spectrum  is 

♦„(m)  ■  y— ■  i  (221) 

The  pertinent  results  (see  Appendix  B,4)  are; 


-2  „  B‘ 

•  ‘TK 

(222) 

ab* 

a  -“T— 

(223) 

(2.' 4) 

^  P 

72:“"  2A 

where  A  >  lOp,  in  order  that  the  following  error  be  small.  If  M  is  the  maximum  allow¬ 
able  rms  acceleration,  then  minimum  following  n.o-or  is  obtained  for  A  *  2M^/B‘’, 

The  ror.ults  for  the  compensated  nonlinear  svs  ..  .n  .vith  N  ■  1,+  Nj  (see  Appendix  P..4) 
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will  also  be  stated: 


.  _  .  3  „  .  1  „2  B** 

ZS  ^  4  "3  ^2  4  "3  ^3 


B‘ 


fi  A  m2 


AB-  .  3  „  B’  .  21  2  B" 
"  2  *  4  “sT  ■'■  32  "3  .2 


and 


'  “T 


,  3  „  ,  3  „Z 

4  "3  ^  ?  "3  ^4 


where  is  iw.!:en  euffioiently  email  that  only  the  first  three  terms  are  sigrifiount.  Now, 
for  example,  we  shall  take  the  numerical  values:  B^  ■  l/2.  p  ■  2/30,  and  ■  S/32. 

2  ~2 

Then  for  the  linear  case,  the  lari'est  allowable  A  >  20/32  and  e  /f  >>  0.  Of. 

^r  the  nonlinear  compensated  case,  with  n^  ■  '■'I',  the  allowable  A  is  1,  and 
■  0,021,  This  represents  a  60  per  oent  decrease  in  the  following  error, 

This  example  shows  what  can  be  done  by  applying  the  functional  representation  to 
nonlinear  systems  with  random  Gaussian  inputs.  It  also  illustrates  the  possible  use  of 
nonlinear  elements  for  servo  compensation  when  the  input  is  a  random  signal. 


5,7  OPTIMUM  SYSTEMS 


Till.  S'  tinn  with  the  problem  of  obtaining  the  realisable  system  that  best 
upp:‘aximates  a  uesired  unrealisable  nocliucar  system  or  operation.  The  desired  sys¬ 
tem  is  unrealisable  because  Its  impulse  response  "starts  before  t  ■  0,"  Best  Is  to  be 
taken  In  the  least -mean -square  sensej  that  is,  the  average  squared  error  between  the 
output  of  the  realisable  system  and  the  output  of  the  rnrealisable  system  Is  minimum. 
The  signals  upon  which  the  sys^oms  operate  are  Gaussian.  Barrett  (6)  has  developed 
an  approach  for  the  general  (non -Gaussian)  signal,  but  there  are  problems  still  to  be 
solved  before  we  can  take  advantage  of  his  approach.  In  this  report  we  are  restricted 
to  Gaussian  signals  or  signals  derived  from  Gaussian  signals. 

We  shall  consider  an  unrealizable  linear  system  with  ».  white  Gaussian  input,  and 
we  shall  find  the  optimum  realizable  system.  Let  the  Impulse  response  h|(t}  be  nonzero 
for  t  <  0,  Then 

flit)*  f  h,(T)  X(t-T)  dT 


or,  if  we  divide  the  I’egton  of  integration  into  two  parte,  we  have 
fj(t)  «  J"  hj(T)  x(t-T)  dT  +  hj(T)  x(t-T)  dr 
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The  .'eglon  w  to  0  coverit  x(i)  in  thr  iuture,  and  the  region  0  to  no  covers  x(t)  in  'he 
past.  If  we  know  only  the  past  of  x(t),  then  t^{t)  can  only  be  cstimutud.  The  beat  ;ncan- 
square  estintate  of  f(t)  la  gj(t),  with 

gj(t)  «  average  of  fj(t)  over  the  future  (2Z6) 


gj(t)  «  J*  hj(T)  x(t-T)  dr  +  hj(T)  x(t-T)  di 


Equation  227  follows  from  Eq.  226  because  x(t)  is  white,  and  therefore  the  past  and 
future  of  x(t)  are  unoorrelated.  Since  x(t)  ■  0  'or  a  Oauselan  (xero>mean)  signal,  Eq,  226 
becomes 

g(t)  >•  hj(T)  x(t-T)  dr  (22t)) 

and  the  beat  estimate,  g(t),  has  been  found.  Putting  this  another  wayi  the  unrealizable 
impulse  response  h|(t)  has  been  replaced  by  kj(t),  where 

f  hj(t)  for  t  >  0 

k.(t) 

0  otherwise 


‘i^*' "  /  k,(-')  x(t-T)  dr 


This  is  a  familiar  result  from  linear  theory. 

Now  we  shall  do  the  same  thing  for  a  second -order  system  in  which 

r  00  roo 

'  /  J  hj^tj.  Tj)  x(t~rj)  xlt-Tg)  dTjdTg 

Splitting  the  region  of  Integration  into  past  and  future  regions  gives 

no 

hjtTj,  T^)  x(t-Tj)  x(t-T^_)  dTjdT, 
eo  “ 

^  fo  ‘‘^I'^^Z 

^/o  fo  '’Z^^l' 


The  factor  2  in  the  second  term  is  obtained  by  taking  advantage  of  the  s^.nmetry 
cf  h2(t|,t2)  and  combining  two  terms.  Again,  g^tt),  the  beat  estimate  of  f2(t),  is 
obtained  by  averaging  over  the  future.  Since  x(t)  -  white  Oaussian,  the  past  and 
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future  are  independent,  and 


/  /  hjlTj.  Tj)  x(t-Tj)  x{t-T2)  dTjdT2 

+  Z  J*  **£(■^1*  ■'j)  dTjdTj 

n« 

hjfTj,  Yj)  ^(t-Tg)  dtjdTj 

Performing  the  indloeted  average*  glvee 
/•O  /•»  /•le 

gj(t)  ■  j  hj(T,  T)dT+J^  hjj(Tj,  Tj)  X(t-Tj)  Xd-Tg)  dTjdTj 

Thue  the  unraa.'texble  eyatem  hae  been  approximated  by  a  realicable  lyetem  K, 
with  K  «  Kj  Kgi  hnd  hae  an  impulie  reeponee 


h2(t|>t2)  for  tj  and  tj  »  0 

0  otherwiee 


and  K  it  sero-order  eyatem  (a  oonatont)  of  value 


/•o 

'  L 


In  g*:i«raii  this  procedure  can  be  uavd  to  ehow  that  an  unrealliable  lyitem  H,) 
replaced  by  a  beet  realicable  eyatem  with 

The  have  Impulee  reeponeee  k,^_^{ti.  •  •  • .  t„.^).  and  for  r  odd  and  all  t^  (where 
1«1. . . .  .n), 

'‘n-r^'l'”'*  Vr^  ■  0 

for  r  even  end  all  t^  »  0, 

.(r-l)(r-3)  ...  jT”  V^l'^1 . 

■^r/Z' ■'r/Z‘*l'’2' '"'‘n-r^  **'^1  ‘*’’r/2 

and  for  r  even  and  eome  t^  <  0, 

>  0  (23 

Now  that  the  realicable  eyatem  which  i*  neareet,  -  the  mean-equare  eenee,  to  * 


71 


- - 1 


'JL'fiilJLi” 


Ik) 


itl 


Fig,  27,  BxiimpU  7.  (a)  Dailrad  optratlon,  (b)  Produotlon  of  x. 

(o)  Daalrad  operation  on  x.  (d)  Optimum  Myeteni  opera¬ 
tion  on  y. 


dealred  unreallaablo  ayatam  haa  been  determined  for  a  white  Oauaalan  Input  algnal,  the 
extcnalon  to  non-white  Oauaalan  algnala  can  be  explained,  By  nneana  of  linear  ahaplng 
filter  a  non -white  Oauaalan  algnal  oan  be  whitened.  Onoe  thin  la  done,  the  optlmlaa- 
tlon  oan  proceed  with  the  raaultant  white  Oauanlan  algnal  ae  input.  That  la,  given  a 
danlreu  oj-.  ■  .tl;;;,  ^  "  Hj  +  . ..  +  tho  algnal  x(t)  le  whitened  by  to  produce  y(t), 
and  the  optimisation  la  made  for  a  dealrod  nyntcim  H  *  with  Input  y(t).  The  reault- 
ant  raallaabia  ayatem  la  S,  and  then  the  optimum  ayatem  la  *  j;(j. 

A  further  genarallaatlon  oan  be  made,  Suppose  that  the  Input  algnal  la  the  reault  of 
(or  the  atatlatloal  aqalvalant  of)  a  known  nonlinear  operation,  L,  on  a  white  Caueelan 
algnal.  Furthermore,  aaaume  that  thla  ayatem  L  haa  a  atable,  reallaable  inverae,  . 
Than,  Juat  aa  before  with  the  optlmlaatlon  procedure  can  be  preceded  by  the 
operation. 

5,8  EXAMPLE  7. 

In  thla  example  we  dealre  to  obtain  the  beat  mean-aquare  eatlmate  of  f(t)  "  y^(t+T), 
where  y(t)  la  a  Oauaalan  algnal,  and  T  la  poaltive.  In  other  worda,  we  want  to  find  the 
raaliaable  ayaiem  oloaeat  to  with 

djftj.tj)  ■  6(tj+T)  aCtj+T)  (2.12) 

Now,  take 

t>%W) 


n 


The  shaping  filter  has  a  trr.-'xfDrm 

D{e+v) 

L,(8)  « - 

(s'l-a)(s+p) 

We  op"vate  on  y(t)  with  ^  to  produce  a  white  Gaussian  x(t),  as  shown  in  Fig,  27b. 
The  desired  operation  on  x(t)  {see  Fig.  27c)  is  Q2  *  Bg  iLii> 

0  T  #  T 

Applying  Eqf.  230  and  231  to  determine  the  btz*  realizable  operation  on  a  white 
Gaueiian  lignal  gives  {{  ■  K2  ®od 

r  -o(t.+T)  -P(t.+T)  •) 


kglti.tj) -jPe  ‘  +Qe  ‘ 

f  -fl(t,+T)  -Wt.+T) 

-  ^  P  e  ^  +Q  o  * 


for  t  j,  t,  *  0 


■  0  otherwise 
and 

»  IjJiP  #"'"^+Q 

where  P  ■  Diy-ai/’/i' •  1,  and  Q  •  D(y-|5)/(«-P).  The  optimum  operation  on  y(t)  is,  then, 
K  *  L^^  and  the  optimum  system  is  shown  ).n  ’^tg.  27d. 

S.9  EXAMPLE  8. 

This  example  deals  with  th.  piedicUun  of  y(t),  where  y  ■  (Ij'*'Li)[x]<  s((l)  1*  h  white 
Gausiian  slgnalj  Sj[s]  ■  s  +  and 

L.lt)  - 5 -  (233) 

‘  (s+e)(s+p) 

Operating  on  y(t)  to  produce 

*  •(Lr‘*N'‘)(y] 

and  performing  the  optimisation  on  x(t)  givee  an  optimum  predictor  J,  which  operatee 
on  y(t),  with 

J-M*K,*N"'  (234) 


ij(s]  ■  m^y  +  y^ 
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wh“re 


nij  ■■  1  + 


3 

(p-a)  \ 


,,-2«iA  ,.p-2pA 


-W 


0  + 


K,<«)  =  c,  +  Cji 


Cj 


Oj  - 


Pe“'^  + 


IP-1) 


(p-o) 

Se8  Appendix  B.  5  for  further  details. 


5. 10  THEORETICAL  DISCUSSION  ON  MEASUREMENTS 


(236) 

(237) 

(238) 

(239) 


The  way  in  which  the  eyatem  Impulse  reeponseb  may  be  obtained  by  measurements 
made  with  a  white  Gaussian  noise  Input  will  be  demonstrated  here.  The  quantities  to  be 
measured  will  be  input -output  orossoor  relations.  However,  at  this  time,  such  meas¬ 
urements  oan  only  be  dtsoussed  theoretioally. 

Let  the  input  x(t)  to  a  linear  eystem  fij  be  white  Gaussian  noise,  and  the  output  be 
f,(t).  Then 

'j':)  :(t-Ti  a  J*  hj(T)  x(t-T)  x(t-'^)  dr 

a  J’h,(T)  6(T-t)  Jt 
•  hj(T) 

This  method,  which  is  known  from  linear  theory  (8),  is  one  means  of  measuring  the 
Impulse  response  of  a  linear  system. 

Nnw  consider  a  quadratic  system  II2  with  input  x(t)  and  output  f^lt).  Then 

fjit)  x(t-Tj)  xlt-Tj)  a  Tj)  x{t-Tj)  xlt-T^)  x(t-Tj)  xlt-Tj)  dTjdxj 

•  ff  h2(ti,T2){6tT2-Tj)6(T2-Tj)+6(Tj-Tj)6(T2-T^) 

+6(T2-Tj)R(T,-T2)}  dTjdT2 

«6(T2-T,)  J  hgiT,  t) -It  +  hjiTj.Tj)  +  h2(T2,Tj) 
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We  note  that  j  {h2(Tj,T2)+H2(T2,Tj)}  la  the  Bymmetrlcal  form  for  the  quadratk-  imoulBc 
reaponae,  and  ao 


fjCt)  Jth-Tj)  xft-Tj)  ■  «(T2-Tj)  j  hj(T,T)dT  i  PhjlTj.T^) 

Meaauremant  of  thla  acoond-order  croaaoorralation,  f2(t)  x(t-Tp  x(t-T2l  *’^^1 
therefore  ylelda  h2(Tj,T2)  for  Tj  *  i’j.  The  function  h2(T,  T)  can  be  obtained  by  oroaa- 

correlating  fjft)  with  {x*(t-T)-x^(t)}.  Than  we  have 

f2(t){x*(t-T)-?(t')}.2h2(T.T)  (240) 

m  "* 

For  white  nolae  x  (t)  doaa  not  exiat,  but  It  doea  axlat  for  any  practical  approximation  to 
white  nolae. 

For  the  oublo  ayatem  Uj,  we  have 

fj(t)  x(t-Tj)  x<t-T2)  Xd-Tj)  ■  6hj(T,.T2,Tj)  +  J6(T,-T2)  J  hj(T,T,Tj)  dr 

+  J6(Tj-Tj)  J* h,(T,T,T2)  dT  +  J6(T2-Tj)  J  hjfr.T.Tpdx 

which  glvee  hj(T,,  Tp,  Tj)  for  T,  a  Tj  d  T,.  To  obtain  hj(Tj,  Tj,  Tj)  In  the  exoluded 
region.  meai><'rot..v.iia  almllar  to  tlie  meneut  emenl  Indicated  in  Bq,  240  can  be  made. 

Higher ‘Order  ayatema  oan  be  handled  In  an  analogoua  manner.  If  the  meaaure* 
menta  are  to  be  made  on  a  eyotem  H  «  Bj  +  +  • . .  +  +  . . . .  then  to  extract  the  Bj 

term,  for  example,  the  meaaurament  of  f(t)  x(t-tT.  where  f(l)  la  the  output  of  IJ  with 
Input  Ax(t),  may  be  made  foi  uti  Input  Ax(t)  for  different  valuea  of  the  oonatant,  A,  7'hen 
the  part  of  fj(t)  x(t-T7  that  vartee  aa  A  will  be  hj|T), 

Similarly,  for  fi!t)  x(t-T|)  x{t-T2).  the  part  that  varlra  at  la  2h2(Tj,T2),  for 
Tj  a  T2.  Thua,  the  Taylor'a>aerlea  method  haa  been  applied  again  to  "eparate  the  var> 
loua  B„  of  the  ayatem. 

5.  11  SUMMARY 

We  have  ahown  how  output  avoragee  and  correlation  funotlona  may  be  obtained  for 
nonlinear  ayatema  deaorlbed  by  the  functional  repreaentatlon.  Rmphtala  haa  been  placed 
on  Oauaalan  Input  algnala,  and  frequency-domain  terhnlquea  have  been  developed  and 
lllualreted  by  example*. 

A  dleouailon  waa  devoted  to  the  problem  of  optimum  nonlinear  operallona  01  Oauaaian, 
or  Qauaalau-derlvod,  nlgnala.  Two  examplea  of  the  optlmlaatlon  procedure  were  given. 
The  aeotlon  on  iheoretloal  maeaiirement  waa  Inteni  1  to  ahow  briefly  how  Input- output 
uroaacorreliMon  meaaure menta  can  ba  ueed  to  menjur.  the  ayatem  ImpulBe  reaponaea. 
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VI.  THEGllETlCAl.  EISCU-S'^mN  OF  FUNCTIONAl.  HEPHESENTATIO'I 

A  number  of  theoretical  topics  concerning  functional  reprasentation  tnd  the  algebra 
of  systems  will  now  be  presented.  In  the  first  few  sections  we  shsll  attempt  to  place 
certain  aspects  of  this  algebra  on  firmer  grouitd.  T/ien  wo  shall  discuss  some  topics 
that  p. 'escribe  theoretical  limitations  on  the  functional  representation, 

6.1  DOMAIN  AND  RANGE 

We  have  streased  the  point  that  the  amplitudes  of  the  input  signals  of  a  nonlinear 
system  are  very  important.  They  are  impoi ia.it  for  two  reasons;  (a)  the  system  may 
act  in  a  radically  different  way  for  two  signals  of  the  same  wave  shape  but  of  different 
amplitudes,  and  (b)  the  method  of  analysis  may  depend  on  some  limltotlons  on  input- 
signal  amplitude.  Therefore,  to  be  rigorous,  we  should  associate  a  certain  input  limi¬ 
tation  with  any  no.ilinehr  system  that  is  being  discussed.  This  limitation  will  be  the 
"domain"  of  the  system.  For  the  system  H  it  w.tll  be  denoted  and  it  is  the  class  of 
all  allowable  Input  aignals.  If  a  signal  x  falls  Ir,  this  clcsu  we  write  (fn  words, 

X  is  contained  in  D^).  A  convenient  way  to  particularly  define  is  to  say  that  there 
exists  a  positive  number  of  X  that  la  such  that  if  |x  |  <  X,  then  x  c  D^j.  In  general, 
there  are  many  ways  to  define  the  system  domain. 

If  B  Djj  is  defined  for  a  system  Ij,  then  the  outputs  f  that  are  associated  with  the 
inputs  X,  where  x  c  D^,  form  a  class  of  signals.  This  class  will  be  called  the  "range" 
of  tho  . jiic:.'..  ■'nd  vill  be  denoted  R^j.  If  f  e  H[x]*  then  f  c  Ry,  for  all  x  c  Djj. 

A  question  now  arlaes  about  wi,ul  buppons  when  we  addltively  combine  two  lyateme 
of  different  domains.  If  t  *  i  i^'  whtre  J  has  domain  Dj  and  K  has  domain  Dj^, 
than  wc  shall  take  the  domain  of  L,  D^,  tu  Uu  the  olaaa  of  aignaia  that  are  contained 
in  both  Dj  and  Iherefore,  we  shall  con  .bJci'  only  inputs  for  ^  that  we  know  err 
allowabla  inputs  for  both  ^  B,td  K. 

Similarly,  for  ths  multtplioetion  combination  L  »  J  •  K,  Dj^  is  the  class  of  signaln 
contained  in  both  Dj  and  D|^. 

For  the  caacadc  combination  L  ■  J  e  K,  we  must  assume  that  the  range  of  K,  Rj^, 
is  contained  in  Dj.  If  this,  is  not  so,  then  must  be  constrained  eo  that  Rj^  is  con- 
tainad  in  Dj. 

In  this  report  we  have  assumed  that  these  points  were  implied  when  we  have 
combined  systems. 

6.2  ALGEBRAIC  LAWS 

The  validity  of  certain  operatlone,  which  has  previcusiy  been  naaun  id  (k<ee 
sec.  2.8),  will  be  estabilshed  here.  These  opcfrations  will  be  presented  an  a  set 
of  theoremi. 


76 


THEOREM  1 ,  If 

A  =  B 

1241) 

then 

A  f  H  B  f  H 

(242) 

and 

H  f  A  =  H  f  B 

(243) 

This  theorem  holds  also 

for  tho  minus  operation. 

THEOREM  2.  If 

A  =  B 

then 

A  *  H  -  B  •  H 

(244) 

and 

H  •  A  =  H  '  a 

(245) 

THEOREM  3.  If 

A  =  B 

then 

H  s  A  =  H  •  B 

(246) 

and 

A  f  H  =  F  *  H 

(247) 

Systems  A,  B,  and 

H  sr>  nonlinear.  These  theorems  are  eosily  proved. 

Let  p  »  A[x];  q  =  B[x];  end  r  =  /j(x].  Then  from  Eq.  Z'il,  p  =  q.  But  p  +  r  =  q  +  r, 
and  eo  A[x]  K[x]  s  B[x]  'f  H[x]  or  A  -t-  H  =  B  -I-  H. 

Axiom  1  (Eq.  34)  givea  H  A  =  H  4  B  directly,  and  so  theorem  1  has  been  proved, 

The  proof  of  theorem  2  is  similar.  Now,  theorem  3  will  be  established. 

Take  p  and  q  as  before,  and  then,  since  p  ^  q,  we  have  H[p]  “  M[q]  or  H[A[x]J  = 
H[§Ixl],  and  so  H  *  A  -  H  *  B.  Hence,  Eq.  246  has  been  proved.  The  proof  of  Eq,  247 
is  a,'i..iK 

iHEOHEM  4.  If  A  and  B  are  known  systems,  and  it  is  desired  to  find  an  H  with 
the  property  that 

H  *  A  -  B  {24«' 

then  H,  ii  it  exists,  is  unique. 

In  other  words,  there  is  one  and  only  one  system  H  that  satisfies  Eq.  248.  (Of 

course,  there  may  be  no  such  system.  For  example,  if  B  =  1  and  A  -■  N,,  then,  because 

2  —  —  -  £ 
we  cannot  tell  whether  x  is  doe  to  x  or  -x,  no  H  exists.)  it  is  assumed  that 

and  H  is  only  defined  with  a  domain  that  equals  the  range  R^. 

To  prove  this  theorem,  take  H  and  (HfK)  to  be  two  systems  that  satisfy  Eq.  248. 

Then  H  *  A  =  B,  and  (H4K)  *  A  =  B.  Hence,  by  theorem  I  (Eq.  242),  H  *  A  -  (HfK)  *  A  ^ 

g  -  B,  or  K  *  A  =  0,  or  K[y|  =  0,  with  y  *  A(x]  and  x  t  D^.  Therefore,  by  the  defini¬ 
tion  of  the  zero  system  (see  sec.  2.  S),  K  :  0,  for  domain  equal  to  the  range  R^^. 
Hence  the  system  H  is  unique,  in  this  domain. 

THEOREM  S.  If  A  it  a  known  system,  and  we  desire  to  find  an  B  which  is  .uch  that 
A*H-  1  (249) 

then  H,  if  it  exists,  is  unique. 
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To  prove  this  theorem  we  precuscade  Eq.  249  with  0  to  obtain  H  *  A  *  H  ^  M  li> 
theorem  3  (Eq,  246),  this  operation  valid,  Theti  we  have 

(H*A)*HsH  (2t!0) 

by  axiom  B  (Eq,  38).  But,  Eq.  250  !<«  obvious), y  solved  by 

ri*A=i  (251) 

and  by  theorem  4,  Eq.  251  is  uni  .ue.  Now,  application  of  theorem  4  to  Eq.  251  shows 
that  0,  if  it  exists,  is  unique.  Hence  theorem  5  is  proved. 

THEOREM  6.  It  A  *  0  =  .1  (252) 

then  H  *  A  =  i 

That  ^*0=1  implies  0*^-1  was  ihown  in  the  proof  of  theorem  5. 

THEOREM  7.  If  A  and  H  are  known  systems,  and  we  desire  to  find  an  H  with  the 
property  that 

H  +  A  s  B  (253) 

then  H  B  -  A  (254) 

uniquely. 

Substitution  of  Eq.  254  in  Eq.  253  gives  B  -  A  4  A  s  g,  and  so  0  ■  g  >  A  is  a 
solution.  To  demonstrate  uniqueness,  two  solutions  are  assumed  and  we  use  the  same 
procQ..  "?  in  the  pfoof  of  tbiorem  4, 

6.3  FEEDBACK  AND  INVERSES 

The  feedback  system  that  will  be  investigut'td  is  shown  in  Fig.  2Sb.  Thi^t  is  a  suf¬ 
ficiently  general  system  iv-cause,  re  was  shown  in  section  2.8,  any  single-loop  feeiioacx 
system  can  be  reduced  to  this  form,  followed  by  a  feed-through  system. 

The  system  equation  is  L  ■  i.-)-  H  *  D.  stter  rearrangement, 

(jhH)  ♦  L  =  1.  (255) 

This  la  recognized  as  an  equation  for  L  of  the  same  form  as  Eq.  249.  From  theorem  5 
we  know  that  L  is  unique.  It  exists,  at  least  in  some  sense,  because  L  is  the  feedback 
system  and  can  be  built.  Furthermore,  from  theorem  6,  we  know  tltat 

L  •  (I-H)  =  I  (256) 

Now,  if 

H  =  1  -  K  (257) 

then,  by  substituting  Eq.  257  in  Eqs,  255  and  256,  we  obtain 

K  *  L  -  l_r  L  ♦  K  (258) 
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Thus  we  have  shown  that  is  possible  to  use  a  feedback  system  to  construct  the 
unique  inverse  of  a  nonlinear  system  K.  An  Inverse  K~^  of  a  system  K  satisfies  the 
property 

K"’  *  K  =  K  *  k“*  =i 

The  feedback  system  of  Fig.  28a  Is  also  an  inversion  system  becatine  we  have  shown 
that 

(I-H)  *  L  "  L  *  (1-H)  »■  i 

Hence  the  inversion  problem  and  the  feedback  pr'-hlein  are  essentially  the  same.  There¬ 
fore,  we  can  write  L  =  K”^. 

As  it  stands,  this  feedback  system  for  obtaining  an  inverse  (see  Fig.  ii&bl  is  not  a 
practical  physical  system  because  of  the  unity  feedback.  A  possible  way  to  overcome 


(ti 


28.  Feedback  and  inversion  i  (a)  feed¬ 
back  system;  (b)  inversion  system; 
(c)  equivalent  Inversion  system. 


«i 


this  difficulty  is  to  use  the  results  of  section  4.  i  to  produce  the  equivalent  system  shown 
in  Fig.  28b,  where  Kj*  is  the  inverse  of  the  linear  part  of  K,  that  is,  Kj,  and  Ky 
form  the  system  (K-K;)- 

Thu  fact  that  the  feedback  system  defines  an  algebraically  unique  system,  and  that 
the  inversion  system  produces  the  unique  inverse,  does  not  exhaust  the  uniqueness  prob¬ 
lem.  Another  uniqueness  problem  will  be  discussed  in  the  next  section. 

6.4  INPUT -OUTFUT  UNIQUENESS 

It  is  quite  easy  to  visualire  a  nonlinear  system  in  which  the  uuir.a  output  is  produced 
by  two  differe.nt  Inputs .  A  simple  example  is  found  in  he  nu-nr,emory  squarer.  If  we 
could  construct  an  inverting  feedback  system  of  the  fui  n  of  Fig.  28b  for  such  a  system, 


tliCiiti  would  bP  two  pcHslble  outputs  a  single  input.  Physically,  such  a  situntion  is 
untenable,  and  the  inversion  system  would  exhibit  some  sort  of  erratic  behavior. 

This  situation  of  two  or  more  possible  outputs  for  a  single  input  is  not  limited  to 
inversion  systems  because  the  inversion  and  feedback  problems  are  essentially  the  st.'tnc, 
and  hence  a  feedback  system  mny  also  exhibit  this  difficulty. 

No -memory  feedback  or  inversion  systems  are  easily  handled  because  the  output 
car  be  plotted  as  a  function  of  the  Input.  Therefore  any  lack  of  uniqueness  at  the  output 
is  readily  detected.  In  the  feedback  system  of  Fig.  26a  the  impulse  reeponsee  are 
bounded  functions.  We  ehall  show  that  for  such  systems  the  inpttt-output  relation  must 
be  unique,  if  an  output  exista. 

We  ehall  consider  the  system  of  Fig.  28a  in  the  particulor  situation  11  =  111+  and 
we  shall  briefly  outline  a  technique  for  handling  it  thr.t  was  described  by  Voltcrra  (1). 

Let  the  input  be  x(t),  and  let  there  be  two  possible  outputs,  f(t)  and  g(t).  Then 

f  =  X  +  K[f] 

and 

g  -  X  +  H[gl 
or 

<  ^  +  Hz[f] 

and 

g  .  »  +  I-  H2[g] 

Subtracting  Eq.  259  from  Eq.  260  yields 

SiJf-g]  +  HjLf]  -  Hjlg] 

But 

HzlO  -  Hglsl  =  -  92<*^> 

=  H2(f*-K^) 

=  H2«f+g)(f-g)> 

Thus  Eki.  261  becomes 
f  -  «  =  Bilf-g)  ^ 
or 

P  Hj[p]  +  HjKf+glP)  (263) 

where  p  -  f  -  g.  Equstion  263  can  also  be  written 


(261) 


(262) 


(259) 

(260) 


80 


p(t)  =  J  hj(T)  p{t-T)  dr  +  Jj‘  h2(Tj.  Tj,){f(t-Tj)+e(t-Tj)}  p(t-T2) 


(264) 


w)ier«!  hj{t)  and  are  the  Impulse  responses  of  and  Hj-  recpeotively. 

Now,  define 

k(t.  t)  =  hj(T)  =  J  h2(Tj,  T){f(t-Tj)  +  g(t-Tj)}  dTj  (265) 

and  Gq.  264  becomes 

p(t)  .  Jk.‘  T)  p(t-T>  dr  (266) 

Since  h^(t)  and  h2(tj,t2)  bounded  functions  and  f(t|  and  g(t)  are  assumed  to  exist 
(that  is,  to  be  bounded),  k(t,  r)  is  a  bounded  function.  Then,  Eq.  266  can  be  shown  to  have 
a  unique  solution;  that  is,  p(t)  <  0.  Therefore,  f(t)  •  g(t),  and  f(t),  the  system  output, 
is  unique. 

This  can  be  extended  to  the  situation  If  =  Hj  +  H2  +  •  •  •  +  where  the  impulse 
responses  are  bounded,  with  the  result  that  the  output  is  unique. 

Certain  unbounded  impulse  responses  can  also  be  considered  by  this  method.  For 
example,  if  li  ■  U2  *  — 1  ^  -2'  shown  that  the  impulse  response  is 

■  “l^h^  impulse  response  of  A^,  and  02*  1.  This  is 

an  unbounded  impulse  response,  and  this  case  can  be  shown  to  be  unique.  The  one  place 
where  this  teat  cs  '  f  ..!!  is  with  H  ■  N  +  K,  when*  N  is  no.memory,  and  K  has  memory 
ur  is  zero,  This  case  ran  exhibit  a  nonuniquc  input>output  relation.  It  seems  to  be  a 
fairly  safe  assumption  that  this  is  the  only  nonunique  situation.  In  case  of  doubt,  the 
teat  procedure  outlined  above  can  be  used  to  tcet  for  uniqueness. 

It  should  be  noted  that  the  fact  that  the  system  uuiput  is  unique  does  not  guarantee 
that  the  system  is  well  behaved.  The  output  of  the  system  may  become  unbounded  (fail 
to  exist),  or  some  other  instability,  such  as  a  limit  cycle,  may  exist. 

6.5  FUNCTIONAL  TAYLOR'S  SERIES 

We  have  mentioned  that  the  functional  aeries  is  closely  related  to  Taylor's  series. 
Here,  thin  relation  will  be  specified  in  more  detail. 

Consider  a  system  |1  with  an  input  ax(t)  starting  at  t  s  0,  whe’'e  a  is  a  constant. 

Let  f(t|)  be  the  output  at  a  time  t  =  tj.  The  output  will  depend  on  a;  therefore  let  tj 
be  implicit,  and  consider  f  as  a  function  of  a  and  write  it  as  f(a). 

Now  we  can  expand  f(a)  in  a  Taylor's  series  about  a  =  0.  Thus 

f(a)  -  f(0)  +  of'(O)  +|-^-  PtO)  +  .  . .  l-i"  f'^No)  +  f<“*‘'(0)  (267) 

where  f*”^(a)  in  the  11^**  derivative  of  f(a),  and  9  is  s.-  .le  .lumber  between  0  and  a. 
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In  particular,  if  tWe  inpu.  is  x(t),  then  a  =  1,  and  we  have 

f(l)  =  f(0)  +  l'(0)  +  f«(0)  +  . . .  +  Vi  V)  (1^68) 

Since  the  input  is  0  when  a  ■  0,  this  can  be  called  a  "Taylor  s  series  about  zero  input," 
The  last  term  in  the  aeries  is  the  error  term  and  if  it  could  be  estimated,  an  idea  of  the 
truncation  error  for  Taylor's  series  could  be  obtained.  Unfortunately,  we  have  not 
been  able  to  estimate  this  term. 


Fig.  29.  Feedback  system. 


In  order  to  illustrate  that  Eki,  268  is  indeed  thu  funut.'onal  series  that  constitutes 
the  basis  of  this  report,  we  shall  consider  the  feedback  system  of  Fig.  29.  Then 
f  >  X  +  K[f]  ■  H[x],  and 

f(a)  -  ax  +  Kj[f(a)]  +  KjtH*)]  +  +  •  •  • 

Therefore 

^  0  +  +  . . .  (270) 

Since  Eq.  270  Is  the  feedback  system  k.!ih  zero  input,  f(0)  ■  0,  Now,  as  we  know  from 
linear  theory, 

^  ■  .KiltMa)] 

Also,  by  symmetry, 

^  Kzt'C)]  ■  £  K^lf^.)) 

=  Ja  ff  ‘‘2<’‘l'  '^2*  *"^1>  *"'"2^  ‘‘^l‘*'^2 

=  jJkjlT,,  Tj)  ^{f(a.t-Tj)f(a.l.T2)}  drjdTg 

*  jj" ''2*{^  f(s,  t-Tj)  f(a,  t-Tjj)  +  f(a,  t-T,)  iia.t-Tj)  j  dTjdTj 

.JS2(f'(a)f{B)tf{a)f'(a)) 

=  2K2(F'(a)f(a)) 
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similarly, 

=  3K3<f'(a)f^a)) 

and  80  on,  for  the  higher -order  terms.  Then 
r(a>  ^  X  +  Kj[f'(a)]  +  aK^CfMajfUi)  +  .. . 
and 

f'(0)  B  X  +  Kj(f'(0)|  +  ZKjlf'WflO))  +  . . . 

But  f(0)  =  0,  and  ao  f'(0)  =  x  +  and,  after  rearrangement,  f'(01  =  (l-JSi)”*[x], 

Similarly, 

f''(0)  =  (zll-Ki)"*  *  Kj;  0  ((l-Kjf'f  )lx] 

and  80  on,  Substitution  of  f'(0).  ffO),  etc.  in  Eq.  26B  shows  that  thu  resultant  series 
is  the  same  as  that  obtained  in  section  2.8  (see  Fig,  14). 

Since  the  functional  series  is  so  closely  related  to  Taylor's  series,  we  should  not 
expect  that  the  functional  aeries  would  always  converge.  The  functional  series 

H  B  Si  +  Hj,  +  . . .  +  +  . . . 

convergeo  fur  •  -  i..,.ai  x(t)  if  the  output  cortcw 
f(t)  .  fj(t)  +  fj(t)  +  . . .  +  f^(t)  +  . . . 

where  f|^(t)  =  I||j[x(t)],  convergee. 

For  example,  consider  the  nystem  .  f  Fig.  30.  The  cystem  equation  is 

f(t)  -x(t)-  /*'  f*(T)  dT  (271) 

tl~aa 

When  x(t)  in  a  step  function,  stcrtlng  at  t  <  o  and  with  amplitude  +1,  it  can  be  shown 
that  f(t)  B  l/(l+t),  for  t  >  0,  by  solution  of  the  differential  equation  (Eq.  271),  If  the 
functional  series  is  developed  for  this  series  and  thu  renult  of  a  unit  positive  step  input 
is  obtained,  we  find  that 

f(t)  »  1  -  i  +  t^  -  t^  +  . . ,  for  t  *  0 

This  series  is  not  convergent  for  t  >  1,  but  the  solution  of  the  differontiai  equation  shows 
that  the  output  is  well  behaved.  Therefore,  if  the  output  of  .a  syittem,  which  is  a  ulyzud 
by  the  functional  serlKS,  is  not  convergent,  we  still  cannot  assume  that  the  output  cl  the 
system  exhibits  erratic  behavior  or  becomes  unbounded 
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Fig.  30.  Simple  feedback  aystem. 

Brilliant  (4)  studied  the  coi.  'ergence  of  the  functional  aeries  and  obtained  a  conserva¬ 
tive  bounding  procedure.  Hir.  results  can  be  extended  somewhat  by  replacing  his  norm, 
||k„l|.  where 

^11  X*  . 

by  a  new  norm,  ||kjj||,j.,  where 

ll‘‘niT*// 

In  this  case  wo  must  constrain  our  considerations  of  the  output  to  the  time  intervai 
0  <t  <  T,  rather  than  to  the  interval  0  <  t  <  w  considered  by  Brilliant.  (We  assume 
here  that  all  inputs  are  xero  before  t  >  0,  and  that  the  impulse  responses  are  realiz¬ 
able  (zero  before  t  <  0).) 

At  the  present  time,  it  appears  that  any  general  convergence  test  should  be  con- 
sorvauve,  an"  ^'...t  it  is  best  to  consider  the  convergence  of  each  particular  case  inde¬ 
pendently.  As  the  example  illustrated,  i-tinvergence  difficulties  can  arise.  From  a 
practical  point  of  view,  however,  the  representation  is  very  unwieldy  if  the  convergence 
is  not  fairly  rapid.  But  the  rapidity  of  convui-genue  can  usually  be  easily  determined 
in  any  particuiar  problem  by  writing  out  a  few  terms. 

6.6  THE  ITBKATION  SERIES 

Even  if  the  functional  series  that  we  have  used  in  this  report  tails  to  converge,  it 
does  not  mean  that  the  functional  representation  fails,  There  is  always  the  possibility 
of  finding  more  general  functional  series  that  will  converge,  In  this  section  S"ch  a 
aeries  will  be  briefly  discussed.  This  series  will  be  called  the  'iteration  scries" 
because  it  is  formed  by  an  iteration  procedure. 

Consider  the  feedback  system  of  Fig,  31,  with  f  =  x  +  t}[f]  ^  A  fir  st  estimuto, 

f|jj,  could  be  made  for  f,  where 

f,j)=x  (2721 

A  second  estimate  is 

'  X  +  H[f(,j]  =  X  +  H[x]  (273) 
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and  Si  tliird  eatlmate  ia 


f(3)  =  *  B[f(2)) 

=  X  +  H[x+H[x]] 

(274) 

In  genera',  the  n^^  estimate  is 

f(n)'*+H['(n-l)l 

(275) 

If  we  let 

^(n)  "  ^{n)f*] 

(276) 

then  ia  an  approximation  to  the  actual  ayatem  4.,  and 

L(l,  “1 

1.(2)  «i+ a 

L(3)  »  1  +  B  *  (l+B) 

by  applying  Eq.  276  to  Eqa.  272,  273,  and  274.  In  general, 

+  (277) 

In  the  limit  aa  n*M,  direct  aubatitution  of  ]U|^|  in  the  ayatem  equation,  L  *  1+  li  * 
for  Fig,  31,  ahowa  that  the  equation  ia  aatlafied.  In  practice  would  not  be  uaed 
in  the  limit,  hut  be  truncated  at  aome  point:  that  ia,  would  bo  uaed  with  a 
finite  n  aa  an  approximation  to  L> 

Any  phyaical  feedback  ayatem  haa  a  delay  around  the  loop.  Thia  delay  la  uaually 
too  amall  to  be  important,  but  it  haa  an  intereating  effect  on  the  iteration  aeriea.  Let 
the  feedback  element  H  be  rcolaced  by  C  *  IJ,  whui  u  Q  delay.  If  thia  la  done,  it 
can  be  ahown  that  the  iteration  acrlea  ia  automatically  truncated  at  aome  where 

n  dependa  on  the  length  of  the  delay  and  on  the  time  after  the  input  haa  atarted  at 
which  the  output  ia  being  obaerved.  Thia  oocura  because  the  iteration  procedure 
of  Eqs.  272-275,  with  Q  replaced  by  D  *  H,  is  the  actual  sequence  01  operations  in 
the  ayatem.  lu  the  first  time  interval,  0  to  A.  where  6  ic  the  delay  time,  the  output 
la  x(t)  because  the  delay  holds  back  the  feedback.  In  the  next  interval,  6  to  2  6,  the 
output  is  x(t)  +  Q  *  |}[x(t)],  and  so  on  for  each  interval.  This  is  precisely  the  iteration 


Fig.  31,  Feedback  system.  Fig.  32.  Hicgram  of  iteration  series. 
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proceflure.  This  can  also  be  visualized  by  means  of  Fig.  32  (which  was  suggested 
n.  D.  Zames).  This  system  is  Cjuivalent  to  the  feedback  system  of  Fig.  with  H 
replaced  by  C  e  (}, 

The  iteration  series,  then,  is  closely  tied  in  with  the  actual  sequence  of  operations 
in  a  feedback  system.  Therefore,  it  seems  reasonable  to  assniae  that  if  the  Iteration 
series  tends  to  become  unbounded,  the  actual  system  output  will  tend  to  become 
unhounded.  (We  note  that  the  delay  in  a  physical  ayatem  will  keep  the  output  bounded 
at  all  finite  times,  but  it  could  get  larger  aa  time  increases  and  the  system  would  then 
be  said  to  be  unstable.)  A  ve>y  aimple  example  nf  this  is  the  system  of  Fig.  31  when 
H  °  A  X  where  A  is  a  constant.  Using  the  iteration  seriss  for  this  system  yields 

f(t)  »  x(t)(l+A+A*+A^+. . ,)  (278) 

and  ililm  ssriss  btcomsa  unboundsd  if  A  >  1,  It  jp  known  from  linear  theory  that  the 
■ystem  is  unstable  if  A  >  1. 

Thus,  we  SIC  that  the  iteration  eeriee  ia  much  more  closely  connected  with  tli.e 
physical  wurlti  then  the  functional  Taylor'a  series.  As  s  practical  tool  it  ia  not,  now, 
vary  useful  because  experience  has  shown  that,  whan  the  Iteration  series  is  rapidly 
convergent,  the  functional  Taylor'a  series  is  also  rapidly  convergent.  However,  it  does 
present  the  possibility  of  using  other  functional  series  than  the  functlunal  Taylor's 
Borlaa. 

The  convergence  of  the  iteration  aerlea  can  often  be  determined.  If  a  linear  feed¬ 
back  ayatem  (Fig.  31  with  H  ■  has  an  input  that  atarte  at  t  «  0,  and  the  impulse 
response  hj(t)  is  bounded,  then  at  any  finite  time  t,  the  iteration  aeriee  can  be  ahown 
to  ij'.  w-4.,ci  ,:p"t  (11). 

Ltt  us  assume  for  s  feedback  system  (Fig.  31)  with  a  nonlinear  feedback  element 
H  that  the  following  (Upaohits)  condition  holds  i 

lH(x)-H(y]l  <  iKjMl  (2^9) 

where  x  end  y  are  any  input  signals,  and  Xj  is  soma  linear  system  with  a  bounded 
impulse  responee.  (Actually,  the  Impulse  response  kj(t)  need  be  bounded  only  over  a 
time  interval  0  to  T  if  we  limit  our  coneiderstlop  of  the  output  to  thie  Interval.)  Then 
we  can  show  that  the  iteration  aeries  for  thie  nonlinear  eyetem  '.unverges  at  any  finite 
time  after  the  input  has  started.  This  is  done  by  appropriately  bounding  the  terms  of 
the  iteration  sariei  of  the  nonlinear  system  by  the  terms  of  the  iteration  aeries  of  ths 
linear  system  obtained  by  replacing  H  by  Kj.  Then,  since  the  Iteration  aerlei  for  the 
linear  ayatem  la  known  to  converge,  the  iteration  aeries  of  the  nonlinear  system  w,,i 
converge.  Referring  to  the  results  of  Section  V,  we  recall  that  the  output  of  such  a 
system  is  unique,  and  hence  the  iteration  seriea  converges  to  the  true  output  of  the 
nonlinear  feadbsnk  system, 

A  system  H  that  satisfies  Eq.  279  might  well  be  c<>.lled  a  "eaturati.  ii"  ayatem 
becauae  it  is  bounded  by  s  linear  system.  An  ordinary  (.aturation  curve  (for  example. 


the  flux-current  uraracterlstic  of  a  magnetic  material)  is  bounded  by  a  linear  curvo. 


6.7  CONTINUOUS  SYSTEMS 

Let  ua  conaider  a  ayitem  H  with  an  input  x(t)  and  an  input  y(t).  From  an  intuitive 
point  of  view,  we  could  aay  that  H  ie  continuoua  if  n[x(t)]  and  H[y(t)]  are  cloae  together 
and  if  xtt)  and  y(t)  are  clone  together. 

Brilliant  (4)  defined  a  much  morn  rigoroua  concept  of  continuity.  F'lrai,  uefino  a 
distance  between  input  functions  x(t)  and  y(t): 


for  r  >  0.  Define  another  diatance: 

|Ii[*(t)]-Hly(t)]| 

between  the  outputs  li[x(t)]  and  £[[y(t)].  Now  we  have  a  precise  measurement  of  dis¬ 
tance,  and  so  closeness  and  continuity  can  be  rigorousl>  dtiined.  The  following  defini¬ 
tion  is  not  the  only  possible  definition  of  continuity,  nor  are  these  distances  the  only 
possible  distances  that  could  be  defined. 

If  we  have  a  time -stationary  system  H,  and  bounded  inputs  x(t)  and  y(t). 
Brilliant's  definition  of  continuity  can  be  stated!  H  is  continuous  if  for  any  c  >  0, 
there  exists  a  T  >  0,  6  >  0  (T  sufficiently  large,  6  sufficiently  small),  such  that.  If 

f  {xii',  >1  <  t,  for  0  4r  *T,  than  |H[x(t)]>H[y(t)]|  <  c.  Brilliant  also  showed 

l-'t-r  i  - 

that  It  £1  is  continuoua,  then  for  any  <  >  0  there  is  a  polynomial  system  con¬ 

sisting  of  the  sum  of  a  constant,  a  linear  system  with  Lebesque  integrable  impulse 
response,  and  products  of  such  linear  systcrus.  such  that,  for  any  bounded  input 
x(tl,  *  <•  That  is  to  say,  if  H  is  continuous,  then  it  can  h*  cloaiuy 

approximated  by 

—0  —1  — n 

where 

Hi  “1^1  Si  ■  •••  ■  fi?i 

^  V* 

i  systems 

The  sum  is  over  a  number  of  such  products. 

This  is  a  sufficient  condition  only  for  a  system  {]  to  be  approxin-  >d  by  the  func¬ 
tional  representation.  Certainly  other  systems  can  be  approximated.  The  atatement 
is,  however,  a  precise  mathematical  theorem  describing  a  set  of  systems  that  can  be 
expanded  in  the  functional  representation. 
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6.8  CONCLUSION 


In  concluBloii,  it  ia  appropriate  to  n.fintion  some  of  the  future  prospeuts  for  the  fu.i'’ 
tiunal  analysis  of  nonlinear  systems. 

First,  of  course,  there  is  the  app.Uci<tion  of  this  form  of  atulysls  to  actual  engi¬ 
neering  problems.  Moreover,  the  general  nature  of  this  system  representation  makes 
it  a  possible  tool  in  the  investigation  of  several  general  problems,  for  exnmpin,  the 
question  of  what  t  onstrainta  on  th(  open-loop  responsu  of  u  nonlinear  feedbscK  system 
are  necssaary  to  ensure  the  stablli.y  of  the  closed  loop, 

The  functional  representation,  as  it  now  stands,  still  presents  problems.  The 
principal  problem  ia  that  of  obtaining  a  seriei.  it.ni  has  rapid  convergence  when  the  func 
tional  Taylor's  series  is  not  rapidly  ccnvsrgent,  or  not  convergent  at  all. 

A  situation  of  considerable  Interest  occurs  when  non-Qausiiati  random  signals  are 
being  investigated.  Optimisation  probleme  then  point  to  nonlinear  aystems,  and  the 
functional  represci  tntion  aenma  to  be  a  good  aystem  description  to  use  for  such  proh- 
leme. 
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akpendix  a 


TRANSFORMS 


1,  SYSTEM  TRANSFORMS 


The  on*. •dimensional  Fourier-transform  pair  is  defined  as 


f’(ju)  «  /**  mi  dt  (A-1) 

fit)  =  2^  y*  *  FIJu)  e*J"*  do.  lA.Z) 

A  multidimensional  gensralization  of  this  is  the  transform  pair: 

W . J“n>  ‘  /*  •••  y'l . ‘n>  ‘^*1  “‘n  «p(-Ja.,tj-. . . 

lA-i) 

'n<‘l . <n>  ‘  (  2i)  . •  ■  +J-„t„)  du,  . . .  du,^ 

(A-4) 

Another  generaliaed  relation  is  the  multidimensional  Parseval  theorem  (6)i 
f.„  V‘l'**’' V  “n**l . ••• 

"  (^)"  ^n‘J"l . J“n>  . J“n>  ‘‘“l  •  *  *  ‘‘“n 

where  “nd  ^n*^"l . •"**  *n*'l' '  ‘ ’  *n^  •”'*  ‘  •*'* 

Fourier^tronsform  pairs. 

If  fit)  ■  0  for  t  <  0  and 

f  |flt)  I  e"'*  dt  <  «o  (A. 6) 

•  0 

where  r  is  a  real  number,  then  we  can  define  the  unilateral  Laplace 'transform  pair: 

FIs)  =  /"  fit)  e'**dt  (A-7) 

•'0 

fit)  *  2^  J  FIs)  ds  (A-P) 

Jf-jK 

wh.^re  a  •  e  I-  <w.  The  multidimensional  gcnerallrutlu  i  ol  this  is 
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(A.')) 


. V 


=  r* 

^CC 

Jo 

Jo  ^  ' 

n 

i^TT  ■■ 

\  •'Vj-joe 

'■/' 

n-j« 


F.  (s, . b„) 

ii  1  n 


exp(+a,tj+. . . ds,  ...  de^  lA-lO) 

where  ej,  ....  are  real  nunAiere.  If  ‘  ‘ '  *n^  Bymmt'trlcnl,  then  (Xj  =  . .  .  = 

e_  =  e. 

n 

2.  ASSOCIATION  OF  VARIABLES 

Ataume  that  we  are  given  ....  t^,)  and  Ue  tranaform  •  •  •  <  •„>•  Thle 

tranaform  may  be  Fourier  (a^^ju^),  or  Laplace.  The  problem  ia  to  find  the  tranaforn' 

of  *2’  *3 . *n*  from  ....  a^>,  (Actually,  we  are  aaaoclatlng  any  two  var- 

lablea  tj.  and  t^  For  convenience,  take  i  ^  1,  J  >  2.  There  ia  no  loaa  in  generality.) 
Call  thia  tranaform  0^-1^*!'  “3'  ‘ ‘  *  *n^‘  »  tj  in  Eq.  A-10,  we  have 

1  N"  r'^n*^" 


V‘l'‘l‘*3 . . 

I  **  n  “ 

expl+ajti+ajt j4-ajtj+, . .  +a„tjj)  daj  , . .  da^ 


(A.ll) 


Tb^n 


vv . . . 

exp(+(aj+a2Mj>  daj|-  e8p(+Sjtj+, .  ■ +•„!„)  da^  . . .  da^  (A 

Setting  aj  +  a2  ■  Uj  glvea 

/  ,  \n  /•e.fjie  /mf  +jfcf  /•v+J«e 


12) 


ytj.tj.tj,  ...,t, 


j-Bj, *2, aj.  ...,a^) 


expl+Ujtj)  dUjj  expitaj  y...+a^y  da^  ...  la^ 
/I  vn-1  ^e+J-  |^eyl■j»  f  , 

A2"jJ  ie-J« 


*2'  *2'  "j* 


(A.13) 
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whftr»  V  is  chosen  so  that  the  inteitral  converges.  Nov/ 

/  ,  \n-l  /.(T+Jop  •ff,+Joo 

*3 . °  (2-j)  j,.j«  ■  ■  •  X  .i« 

“a . "n*  exp(+3jtj+S3t3+. . .  dt,dt3 


dt.. 


and  hence,  If  s^  Is  replaced  hy  u,  and  Uj  by  Sj,  in  Eq,  A-13,  we  have 

»2~J* 

Specification  of  n  r  2  gives  Bq.  IIS. 


1 

. . F„U,-u.u,S3 . s„)  du 


(A. 14) 


(A. IS) 


3.  FINAL-VALUE  AND  INITIAL- VALUE  THEOREMS 

Consider  a  multidimensional  function,  f_(t, . t„),  and  its  transfurin,  F_(S| ,  . , .  ,s.). 

n  i  n  n  1  n 

Define 

«l<‘li*2 . 'n*  -/X  •••  /X  yn . Vexp(.Sjtjj-...-s„gdt2  ...  dt„  (A.16) 

Then  tl.c  "rst-order  transform  of  •  •  •  *  "n* 

ai<«ii«2 . ■„>  »  X*  . dt, 

»  F^(», . «„)  <A.17) 

Now,  if  we  regard  S2 . *„  as  fixed,  Ii(iiia2'  ‘  ‘  *n*  *^l*''l'*2 . ^n^ 

a  first-order  transform  pair.  Then,  from  linear  theory  (9),  we  have 

lim  g,<t,iS,,  . . . ,  s  1  >  lim  G,(a,;s«, . ,  . ,  B„)  s,  (A-IS) 

t,-«o  *  ‘  "  s.-O  *  *  *  "  * 


and  therefore 


(A-19) 


lim  g.it.jSj . B  )  =  lim  F  (B. . s  )  s. 

t,-«o  ‘  ‘  "  Sj-0  "  '  "  ' 

But 

«l“l'‘'2 . V%‘“"  X  ■••X  V.<‘l . •n>«P<-'‘2‘2-'--Vn>‘“2  •••  <1*0 

’  fo"  ■■■  /."{.“--'""l . n’}""'-*'!---  .V  <‘>2  ■  •  ■ 


(A. 20) 
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Therefore  the  transform  of  llm  f(t,,..  t  )  is 

t.-oo  "  '  ’  n 


fnffi. . 8„)8, 

Bj**0  ^  *  tt  I 


Thl.  justifies  the  limiting  procedure  used  in  section  5,4, 
Successive  use  of  Eq,  A-ZJ  ahowa  that 

i‘,-" . ‘"’■.“^0  V'l . 


t^-« 


•n-0 


Now 


'A-2t) 


(A-22) 


<A-Z3) 


t  '^86 
n 


where  f„(t)  *  f(„j(t.  t. . . . 
In  a  similar  manner. 


.  t),  and  so  the  flnal-value  theorem  of  section  3. 4  is  proved, 
the  initlal.value  theorem  of  section  3.4  can  be  proved. 
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APPENDIX  B 


PROBLEM  DETAILS 

In  this  appendix,  we  shall  give  ft'.rtiier  detailifi  for  some  of  the  problems  of  Sections  III 
and  V. 

1,  PROBLEMS  OF  SECTION  3.  b 
System  A  is  given  by 
K  *  N  *  H, 

»  Kj  +  Kj  +  Kj  (B.i) 

where  the  coefficients  associated  with  the  nonlinear  no-memory  system  fj  «  1 1-  £1^  4- 
are  n^  and  n|j.  Since  Kj  has  a  transform  H/(s+u).  the  ti  si  sfcrms  of  the  system  K  are 


IB-Z) 

n  H® 

Kj(B,.  S,.  S-)  a  - ^ - 

^  ^  (Sj+aJCSjtejiSj+B) 

(B-3) 

n.H' 

*  *  *  (Sj+e)  ...  (sj+s) 

(B-4) 

by  use  of  Eq.  90.  The  input  is  Re  and,  fr  .'m  section  3.  3, 

of  the  first-harmonic  output  is 

the  complex  amplitvici<' 

Kj(jw)  +  1  Kj(Jw,  ju,  -jw)  +  y  Kj(ju,  Jw,  Jw,  -j«,  -jw) 

<B.5) 

The  third -harmonic  complex  output  amplitude  is 

^  KjiJw,  jw.  Jw)  +  ^  Kj(jw.  Jw.  Jw.  Jw,  -Jw) 

(B-6) 

and  the  fifth-harmonic  complex  output  amplitude  is 

i^KjtJu,  . ,  ..Jw) 

(B-7) 

Substituting  the  expressions  for  the  transforms  (Eqs.  B-Z,  B- 

'3,  and  B-4),  taking 

w  =  0,  and  defining  B  a  H/o  (the  linear  undisiurted  gain)  gives  the  low-fr -iquency 

a.'npiitudes ; 

first-harmonic  amplitude  =  B  +  ^  n^B^^  +  ■!  n.L  x* 

(B-8) 
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third-harmon'c  amFUtuile  ■ 

fifth-harmoiilc  amplitude  =  ^ 

Defining 

'ir.t -harmonic  distortion  = 

third-harmonic  distortion  ^-^rfjth»rmonic_amE.ljtude. 

fifth-harmonic  amplitude 
fiftn -harmonic  distortion  - - - 


(B.9) 

(B-10) 

(B-ill 

(B-i2) 

(B-i3) 


and  substituting  Sqs.  B-t  to  B*  10  gives  Bqs.  145-' 47  of  example  2. 

Now  the  feadbaok  system  B  can  be  considered.  The  system  equation  is 

L«N*H,  ♦(AL)  (B-14) 


where  A  is  a  gain  constant,  and  h  represents  the  feedback  system.  Substituting 


Eq.  144  for  jS,  taking 

and  determining  L^.  methods  of  section  2.  8  yields 

t,  .  Bj  *  (l+Aa,r* 

hi  •  (i+AH,)"*  •  (3n3(ti  •  <AHfki))  i  «5lJ) 

for  the  first  three  terms.  (All  ev>‘n  terms  are  sero.) 


The  transforms  that  are  found  by  the  relations  in  section  2. 9,  are: 

Li<*»  -TT^V-SH- 

,  .  S}  t  +  S3  +  AH  H _ H _ ^ _ H 

V*!'  ’2’  3’  ■  S|  +  s^  +  S3  +  a  +  AH  3  s j '+  0  +  Sg  +  o  +  AH  Bj  +  a  +  AH 

(B.?.0) 


s.  +  ...  +  Sj  +  a  r 

LjlSj,  •■••Sj)  =  3.  ^  Sj  +  0  + AH  \^"3^l**l*  B^'rs^4  Bj  + 

X  L3(Sjtk2^*3)  +  "5Li(»i)  .*. 


(B.2U 


Calculating  the  distortion  ratios  as  we  did  in  Eqs.  B-B  to  B-13  gives  Kqs.  148. 
149,  and  1.50  of  example  2.  If  the  conditiona  on  >.3  .nise  of  the  distortion  rutios 
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Kiven  in  example  3  are  mti.  then  these  three  terms  of  the  scries  for  h  v/ill  be  smli- 
cinnt. 


2.  PROBLEMS  OF  SECTIONS  3.  6  AND  3.  7 


From  the  traneform  N  »  N^  +  N^,  the  system  equation  U 


L  »  AN  *  Hj  *  a-L)  (B.2Z) 

where  A  is  the  gain  constant.  Hj  is  an  ideal  integrator,  and 

N[y]  ■  sin  y  {B-23) 

Taking 

L^Lj+l,,  +  ...  (B.24) 

and  applying  the  methods  of  section  2. 6  gives 

Lj  -  (I+AHj)  *  AHj  {B.25) 


L, .  -  ••  (i+AHj)-*  *  (B.26) 

L,  •  a+AH,r'  Af^  Lj)'  •  Lj  ^  L,)*)  (B.27) 

The  transforms  are  found  by  the  rol^tlons  in  section  2. 9,  and  arc  given  in  Eqs.  152, 
IS 3,  and  1S4  of  example  3.  The  output  transforms  are  given  in  Eqs.  155,  157,  and  15B. 

The  output  transform  Rj(s)  is  obtained  from  Eq.  157,  by  the  association  procedure, 
as  follows: 


(Si+Sj+Sj) 


n  i  \  no  A  M  ^  '  *  * 

”(3)'*r  *2' *3*  “JT"  Sj  +  Sj  +  B  J  +  A  Sj(S2tA)  SjISj+A)  s  j(Sj+A) 

/.s’  (Sj+s^teJ  1  1  r_i_  1  1  fi  _ 1_  1 

o" Isj+Sj+Sj+A)  SjIsjtTC)  ^2"|^B2  ■  Sj  +  Aj|sJ  "  s ^  +T f 


Associating  *3  gives 

R  (.1  .  -  s’  *1  ^  *2  _ 1_  /i.  .  2  ,  1  '! 

"r*'  "■  u j  +  +  A  Bjftj+AT  +  ^  ^  iJTTTT  j 

*1  *2  fj _ i_  in  2  1 

ij+Sjj-TStSj  Sj  +  T^m  s,,  ■  s^TX  i'j +TA 


and  ast'''''iating  Sj  and  gives 


(B-28) 


(B.29) 
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_s  f  1_ _ 3  .  _  __3 _ 1 I 

+  'S\'s~i  +  A“g  +  2A  8  +  3AJ 


(B-30) 


. *5’  «j  +  ...  +  *5  + 


>1  T  -2  *3  T  «  B,,.;, 


■  ‘  "(JiU+S? 


(B..31) 


wh«re  the  eecond  term  with  coefficient  ^  hae  been  neglected  becauae  it  ia  small.  Car¬ 
rying  out  the  association  procedure  on  this  basis  gives 

-  .  1  S®  S  fl  0.5  5  8  4  .0.5  JA 

•  7  ^  Tjn  -  rrs  ‘  r+~2i + rrm  -  mx  +  sTsx  ■ 


(s+EA)‘  (S+3A)‘  . 

The  transform  of  the  output  is 
R(s)  .  Rj(«)  +  Rjis)  +  Rjls) 


(B..32) 


<B.33) 


an**  the  terms  can  be  culleoted  and  inverted  b>  the  usual  linear  methods  to  give  the 
output  '•'*)  Ai  !■  given  in  Bq.  ISO  in  uxampie  4).  Only  ono  of  the  multiple-order  poles 
gives  a  significant  oontribution  if  A  x  i. 

3.  PROBLEMS  OF  SECTION  5.  5 
The  transform  of 


L,(s,.b,)  - - 5-2 - 

*  '  “  (Sj+Sj+pXSjtaJISj+s) 


and  we  want  to  roicuUte 


/•2<--' 


(B-34) 


(B-3^) 


by  the  method  of  section  5.4.  Therefore  we  associate  Sj  and  in  Eq.  B-34,  which 

gives 


(a'«-hMaf2a) 


<B-3(.) 


9b 


M  (T,  T)  dT  T  lim 

J  2  8-0 


A^B 

(St'P)<842a) 


(B.37) 


if  B  >  and  80  the  firat  term)  of  Eq,  218  is 


Next,  we  want  to  calculate  the  eecond  term  of  Bq,  218.  Equation  219  ia  the  trana- 
form  of 


2  JJ  ■'2^  '^2'*'''2^  ‘*‘''l‘*''2 

and  vve  want  to  aaaociate  a^  and  in  Eq.  219  (T|j  and  T2  in  Eq.  B-39).  Thua 
ZLgl-ej.-B^)  Ljiaj.aj)  "  |-a,*+  a  ^  i7^‘} 

Aaaoolatlng  a^  and  gives 

A^B*  1  1  r  I  .  I  1  1  \/  I  \ 

-j;j-  T>T  Tm]  “  » 


(B.39) 


(B-10) 


(”•  i  i) 


Thia  ia  the  transform  of  the  second  term  of  Eq.  218.  Setting  a  ■  Jw  and  combining  the 
two  terma  givea  the  transform  of  9f(T).  which  ia  the  spectrum,  d^lw).  The  result  is 
Eq.  220  in  example  5. 


4.  PROBLEMS  OF  SECTION  5.  6 

First,  we  obtain  Eq.  222.  Linear  system  analysis  shows  that 

E(a)  .  X(B)  (B.42) 

where  E<s)  and  X(al  are  the  transforms  of  e(t)  and  x(t),  respectively.  But 

X(B)  =  Y(b)  (B.43) 

where  Vl^)  ia  white  aaiiaaian  noise  and  n/ta-t,').  from  in  Eq.  221,  ib 
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(n.«| 


the  shaping  filter.  Then 

« =  Kily] 

Where  {Jj,  from  Eqe.  8-42  end  8-43,  haa  .  i..-inaform 

■  B 

rrs"  F-p 

Now 

e^(t)  ■  J  y^{r)  k,(T)dT 


(B-.'ll) 


(B.46) 


and,  by  application  of  the  output  wveragea  of  aectiou  5.  2,  (e^(t)  ia  'ji't)  e(t+T)  evaluated 
at  T  o  0).  Thu  tranaform  of  kj(tj)  kjCt^)  la 


Ba^  Ea^ 

(a^+A)(aj+p)  (aj+A)(a2+p) 


(B.47) 


and  by  aaaooiating  aj  and  a^,  the  tranaform  of  kj(t)  kjlt^)  ia 


(A-P)^ 


a  +rrff  ^a  +  2pJ 


Aaauming  that  A  »  p,  we  have 


(B.4a) 


C  ^^|  m  Urn 


3Z 


i-o  7  rra 


(B.4'>' 


Which  a  Bq.  222  m  example  6.  Bquatlona  223  and  224  are  obtained  in  a  almilar  manner. 
(Bquation  B.49  can  be  obtained  by  atandard  linear  methods  (S)i  it  is  derived  here  by  the 
methods  of  Section  V.  in  order  to  illustrate  this  application  to  linear  analysis.) 

The  nonlinear  compensated  system  will  now  be  considered.  The  first  two  system 

transforms,  L,(s)  and  LjiSj.Sj,  Bj),  are  given  in  Eqa.  10b  and  106,  The  output  error 
ia  given  by 


e(t)  r  f(t)  -  *(t) 


(B.  10) 


where  x(t)  la  related  to  the  white  Qauaslan  y(t)  by  Eq.  B-43. 

that  nj  is  sufficiently  small  that  only  e.(l)  and  e,(t)  contribute 
e(t))  that  ^ 

e(t)  -  e,(t)  +  Sjlt) 


We  can  shov;  (assuming 
Hignificantly  to  the  error 


where 


(B<51) 


(Ho;!) 


*3  = 

and  Kj  and  have  tt-anaforms 


<B.54) 


B  B  B 

*,)  *  ,J  +  •“+  Bj  +  yv  iTTTf  TpTK  ^fTR' 
Here,  we  have  taken  p  ^  0,  Then 

e^t)  .  e*(t>  +  Zej<t)  +  #](t) 


(B-S5) 


(B-S6) 


2  2 
where  ej(t)  la  givan  in  Eq.  B-49.  The  other  two  terma  of  o  (t)  can  be  computed  by 

the  methoda  of  aectlon  9. 4.  _ 

To  illuatrate  thla  point  we  ohall  compute  ej(t)  e2(t).  Now 


ej(t)  ejit)  ■  (Kj'JSjlIyjyjVjy^) 


*  ff  Tj)  tlTjdTj 


from  Eq.  199,  with  T  «  0.  Ut 


Jkjit, 


f)  dr  ■  bit) 


(B.S7) 


<B.98) 


The  tranaform  of  thia  term,  B(s),  haa  been  worked  out  in  Eqa.  £13  and  214>216.  Taking 
K  ■  AB^nj  and  a  <  |S  ■  A  lit  Eq.  216,  givea 


_  (  1 

■  2  W 


The  tranaform  of  k^itj)  b(t2)  i« 


_JB  S'nj 
aj  rs  r~ 


{^r 


(B.59) 


(B-60) 


Now  we  can  complete  the  evaluation  of  Eq.  B-97  by  aeaociating  aj  and  82  in 
Eq.  B-60  to  give 


(B.61) 


79 


)  =  lim 

‘  *  ■-O 


\s+2A 


3^ 

-¥  ^2 

2 

In  a  almllar  mannar,  aj,(t)  can  be  rotnputad. 

5.  PROBLEMS  OF  SECTION  S.  9 

The  denlrad  operation  on  y(t)  ie  a  predictor  P,  -/rith  the  desired  otitpt\t 
d(t)  .  y(t+T) 

-  p[y<»>] 


(B>62) 


/ 


•  I  6(t-T)  y(t-T)  dT 


{B.63) 


£,  therefore,  hae  an  impulae  reiponae  p(t)  a  8(t-T),  The  white  Qauaaian  x(t)  is 
obtained  by  operating  on  y(t)  to  produce 

whence  the  oef,  .-i  operation  on  x<t>  to  produce  d(t)  ia 
P  *  (N*Lj)  •  P  *  (Nj+Nj)  •  tj 

■P*LltP*(Lj) 

Thia  operation  ia  the  aum  of  a  firat-order  ayatem  nnd  a  third>order  ayateni,  and  the 
impulae  reaponaea  are 


(B.65) 


and 


IjU+T) 


lj(tj+T)  ljUj+T)  l3(tj+T) 


(B.66) 


(B.67) 


where  lj(t)  ia  the  impulse  reaponee  of 

Inverting  L|^(a)  in  Eq,  233  and  app)ying  £q.  230  gives  a  best  realizable  rystem  H, 
with 


H  ■*!„)  +  «,?) 

9(1)  *  9i_o  +  Si_i 

’  -3-0  *  ^03-1  ^-3-2  -3-3 


(B-ba) 

(B.<>9) 

(B.70) 
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Then  the  optimum  output  f(t)  is  aiven  oy 


f  *  H[x] 

‘(h  •  (B-71) 

Working  out  the  Impulse  rear''naes  of  H  by  means  of  £q.  2ii  shows  Uihi 

H  ♦  Lj*  ♦  =  M  a  Kj  ♦  N'‘  (B.72) 

The  detailed  nature  of  M  and  are  given  £qa.  235>239  In  example  6, 
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